00000001:02000400:0.0F:1784184680.355052:0:2968:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1784184704.431964:0:3189:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1784184706.885945:0:3252:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 523 MB/s 00000001:01000000:3.0:1784184707.135784:0:3252:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 587 MB/s 00000001:01000000:2.0:1784184707.385387:0:3252:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4075 MB/s 00000020:02000000:0.0:1784184708.304322:0:3281:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_gdc75e25 00000400:02000000:0.0:1784184709.215824:0:3297:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.201.129@tcp [8/256/0/180] 00008000:02000000:2.0:1784184712.904645:0:3446:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1784184771.626904:0:5250:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784184781.271054:0:5773:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784184781.271061:0:5773:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784184781.271301:0:5773:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000036e8951f 00000080:02000400:3.0:1784184781.271314:0:5773:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1784184781.275609:0:5773:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784184781.275623:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784184781.275663:0:5773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000088e094bb) 00000020:00000080:3.0:1784184781.275684:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784184781.289939:0:5773:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784184781.290431:0:5773:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784184781.316699:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784184781.316742:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784184781.316763:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784184781.316902:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784184781.316930:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784184781.318018:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784184781.318029:0:5773:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784184781.318042:0:5773:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8afc79 00000020:01000004:2.0:1784184781.318050:0:5773:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1784184781.318055:0:5773:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784184781.318060:0:5773:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000036e8951f from MGS 00000020:01000004:2.0:1784184781.318065:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784184781.318084:0:5773:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009d11b68f) 00000020:00000080:2.0:1784184781.318096:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784184781.318294:0:5773:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000036e8951f from MGS, refs=2 00080000:01000000:2.0:1784184781.318299:0:5773:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784184781.318305:0:5773:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8afc87 00000100:00100000:2.0:1784184781.318452:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784184781.318583:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784184781.318591:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784184781.320106:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784184781.320117:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784184781.320891:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784184781.321054:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784184781.321059:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1784184781.322249:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1784184781.322259:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784184781.322867:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784184781.322880:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1784184781.323654:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184781.323663:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184781.323665:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184781.324016:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184781.324019:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184781.324021:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184781.324663:0:5773:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784184781.328300:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784184781.579746:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2760 MB/s 00000001:01000000:2.0:1784184781.829525:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3383 MB/s 00000001:01000000:2.0:1784184782.082613:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 553 MB/s 00000001:01000000:3.0:1784184782.335667:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 505 MB/s 00010000:00010000:1.0:1784184782.352523:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1784184782.352815:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1784184782.385161:0:5773:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1784184782.385219:0:5773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784184782.385223:0:5773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1784184782.396112:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784184782.396257:0:5773:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784184782.396310:0:5773:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784184782.396605:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784184782.396637:0:5773:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784184782.396971:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784184782.397126:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784184782.397132:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784184782.404382:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784184782.404510:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784184782.407666:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784184782.407692:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784184782.410630:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784184782.410657:0:5773:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:3.0:1784184782.410659:0:5773:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784184782.410710:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:3.0:1784184782.410723:0:5773:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (00000000fbc8fdbf) 00000020:00000080:3.0:1784184782.410743:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784184782.410822:0:5773:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009c55ad9b@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1784184782.411012:0:5773:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:3.0:1784184782.411019:0:5773:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 00000100:00080000:2.0:1784184782.411480:0:5788:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784184782.426884:0:5789:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784184782.427025:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid dd3a63d1-a8e3-43ef-9771-5d6fc11873d7) 00000020:00000080:1.0:1784184782.427048:0:5773:0:(genops.c:1406:class_connect()) connect: client dd3a63d1-a8e3-43ef-9771-5d6fc11873d7, cookie 0x63160f6fbe8afc95 00000100:00080000:1.0:1784184782.427061:0:5773:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784184782.427067:0:5773:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import 000000009c55ad9b using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1784184782.427137:0:5773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cb602274 x1870853265424512/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784184782.427165:0:5773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS 00000020:01000004:1.0:1784184782.427184:0:5773:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784184782.427189:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784184782.427207:0:5773:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005403ffcb) 00000020:00000080:1.0:1784184782.427219:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784184782.431427:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cb602274 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3312:1870853265424512:0@lo:250: 00000100:00100000:2.0:1784184782.431547:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184782.432055:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265424512 00000100:00100000:3.0:1784184782.432064:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265424512 00000100:00100000:3.0:1784184782.432105:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784184782.432112:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009504f6be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1870853265424512:12345-0@lo:250: 00010000:00080000:3.0:1784184782.432163:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from dd3a63d1-a8e3-43ef-9771-5d6fc11873d7@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1784184782.432190:0:5784:0:(genops.c:1406:class_connect()) connect: client dd3a63d1-a8e3-43ef-9771-5d6fc11873d7, cookie 0x63160f6fbe8afca3 00000100:00080000:3.0:1784184782.432368:0:5784:0:(import.c:65:import_set_state_nolock()) 000000005c287521 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784184782.432460:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009504f6be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:3312:x1870853265424512:12345-0@lo:250: Request processed in 347us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184782.432468:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784184782.432536:0:3312:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784184782.432545:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:3.0:1784184782.432552:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784184782.432566:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784184782.432569:0:3312:0:(import.c:65:import_set_state_nolock()) 000000009c55ad9b MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784184782.432571:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784184782.432580:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784184782.432585:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cb602274 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3312:1870853265424512:0@lo:250: 00000100:00100000:3.0:1784184782.454173:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784184782.454435:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784184782.454443:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784184782.459740:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784184782.459760:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784184782.460686:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784184782.460698:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784184782.461856:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784184782.462202:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784184782.462208:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784184782.463139:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784184782.463149:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784184782.518720:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784184782.521055:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784184782.521070:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784184782.528157:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784184782.528183:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784184782.535305:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784184782.535575:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784184782.535581:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784184782.536614:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784184782.536626:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784184782.537545:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784184782.537745:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784184782.537751:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784184782.540289:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784184782.540327:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784184782.541732:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784184782.541922:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784184782.541928:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784184782.546017:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784184782.546033:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1784184782.593945:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784184782.594267:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784184782.594273:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784184782.603689:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784184782.603826:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784184782.612323:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784184782.612394:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784184782.614079:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784184782.614113:0:5773:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784184782.614132:0:5773:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784184782.614286:0:5773:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784184782.614318:0:5773:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784184782.614323:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784184782.614326:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784184782.614327:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784184782.614328:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784184782.614360:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784184782.614362:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784184782.614363:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784184782.614365:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784184782.614366:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784184782.614367:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784184782.614369:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784184782.614370:0:5773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784184782.614372:0:5773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784184782.614374:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784184782.614375:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784184782.614376:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784184782.614377:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784184782.614378:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784184782.614379:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784184782.614380:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784184782.614381:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784184782.614382:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784184782.614383:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784184782.614384:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784184782.614385:0:5773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784184782.614428:0:5773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784184782.614448:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cc8b0dff pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265424640:0@lo:253: 00000100:00100000:3.0:1784184782.614517:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184782.614573:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af66580a going to sleep for 11 seconds 00000100:00100000:1.0:1784184782.614666:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265424640 00000100:00100000:1.0:1784184782.614674:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265424640 00000100:00100000:1.0:1784184782.614721:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784184782.614729:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d23b1ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:5773:x1870853265424640:12345-0@lo:253: 20000000:01000000:1.0:1784184782.614774:0:5787:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784184782.614777:0:5787:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1784184782.626615:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784184782.626700:0:5787:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1784184782.627063:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784184782.628265:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1784184782.628840:0:5787:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784184782.628845:0:5787:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1784184782.628850:0:5787:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1784184782.628853:0:5787:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1784184782.628882:0:5787:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1784184782.629087:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784184782.629445:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1784184782.629460:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784184782.629506:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1784184782.629570:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1784184782.629610:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1784184782.629698:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1784184782.629706:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1784184782.629750:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1784184782.629759:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1784184782.629788:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1784184782.629794:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1784184782.629822:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1784184782.629866:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1784184782.629896:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784184782.629901:0:5787:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1784184782.629913:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784184782.631017:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1784184782.631040:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784184782.631097:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1784184782.631206:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1784184782.631268:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1784184782.631282:0:5787:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1784184782.631407:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1784184782.631416:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784184782.631462:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1784184782.631498:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1784184782.631532:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1784184782.631542:0:5787:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1784184782.631638:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1784184782.631647:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1784184782.631691:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1784184782.631721:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1784184782.631898:0:5787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1784184782.631945:0:5787:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784184782.631952:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1784184782.635412:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784184782.643413:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784184782.643450:0:5787:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.129@tcp for mdt 20000000:01000000:2.0:1784184782.643452:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:2.0:1784184782.643488:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784184782.643496:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784184782.643528:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784184782.643534:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:2.0:1784184782.643587:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1784184782.643597:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784184782.643645:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1784184782.643678:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1784184782.643741:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784184782.643744:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784184782.643750:0:5787:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784184782.643756:0:5787:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1784184782.645610:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1784184782.645794:0:5787:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1784184782.657680:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1784184782.657732:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1784184782.657806:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1784184782.657825:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784184782.657828:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784184782.657832:0:5787:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784184782.657928:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784184782.657931:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784184782.658122:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784184782.658125:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784184782.658703:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1784184782.658993:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1784184782.659026:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1784184782.659075:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1784184782.659086:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784184782.659088:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784184782.659618:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1784184782.659779:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1784184782.659822:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1784184782.660186:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1784184782.660202:0:5787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784184782.660205:0:5787:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1784184782.660212:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784184782.660231:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660246:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660256:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660262:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660268:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660275:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660280:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3ad830d already unused, calling callback (00000000b55e7716) 00010000:00010000:1.0:1784184782.660284:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660291:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660303:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660323:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184782.660328:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcaa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784184782.660393:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784184783.040737:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d23b1ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:5773:x1870853265424640:12345-0@lo:253: Request processed in 426000us (426210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184783.040758:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784184783.040878:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cc8b0dff pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265424640:0@lo:253: 10000000:01000000:0.0:1784184783.040895:0:5773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784184783.040899:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784184783.040901:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784184783.040902:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784184783.040903:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784184783.040905:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784184783.040906:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784184783.040907:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784184783.040909:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784184783.040910:0:5773:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784184783.040911:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784184783.040913:0:5773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784184783.040933:0:5773:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000036e8951f from lustre-MDT0000 10000000:01000000:0.0:1784184783.040981:0:5773:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784184783.040983:0:5773:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784184783.040988:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b5f90580000 10000000:01000000:0.0:1784184783.040992:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784184783.040999:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b5f90580000 from 1 10000000:01000000:0.0:1784184783.041002:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784184783.041043:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.041065:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.041073:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.041091:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265424768:0@lo:101: 00000100:00100000:0.0:1784184783.041128:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.041200:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000098c49be going to sleep for 11 seconds 00000100:00100000:2.0:1784184783.041356:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265424768 00000100:00100000:2.0:1784184783.041364:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265424768 00000100:00100000:2.0:1784184783.041404:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784184783.041413:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b754ae49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:5773:x1870853265424768:12345-0@lo:101: 00010000:00010000:2.0:1784184783.041426:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184783.041440:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afcb1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.041462:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.041471:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.041491:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000912b55eb, rc 0) 00000100:00100000:2.0:1784184783.041528:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b754ae49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:5773:x1870853265424768:12345-0@lo:101: Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.041533:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784184783.041717:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265424768:0@lo:101: 00010000:00010000:0.0:1784184783.041731:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.041739:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.041792:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265424896:0@lo:501: 00000100:00100000:0.0:1784184783.041816:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.041841:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000098c49be going to sleep for 11 seconds 00000100:00100000:3.0:1784184783.041891:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265424896 00000100:00100000:3.0:1784184783.041895:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265424896 00000100:00100000:3.0:1784184783.041926:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784184783.041932:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7e3a807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:5773:x1870853265424896:12345-0@lo:501: 00000100:00100000:3.0:1784184783.042173:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7e3a807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:5773:x1870853265424896:12345-0@lo:501: Request processed in 232us (348us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784184783.042181:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784184783.042526:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265424896:0@lo:501: 10000000:01000000:0.0:1784184783.042568:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784184783.042587:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.042595:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184783.042615:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b5f85958000 10000000:01000000:0.0:1784184783.042619:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784184783.042623:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b5f85958000 10000000:01000000:0.0:1784184783.042626:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784184783.042629:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b5f85958000 from 1 10000000:01000000:0.0:1784184783.042631:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784184783.042652:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000d53454b2/0x63160f6fbe8afcbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.042658:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000d53454b2/0x63160f6fbe8afcbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.042665:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000d53454b2/0x63160f6fbe8afcbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.042677:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425024:0@lo:101: 00000100:00100000:0.0:1784184783.042704:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.042739:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000098c49be going to sleep for 11 seconds 00000100:00100000:1.0:1784184783.042846:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425024 00000100:00100000:1.0:1784184783.042851:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425024 00000100:00100000:1.0:1784184783.042887:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784184783.042902:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f4905f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:5773:x1870853265425024:12345-0@lo:101: 00010000:00010000:1.0:1784184783.042911:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184783.042921:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afcbf expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.042941:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afcbf expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.042951:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3ad830d/0x63160f6fbe8afcc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afcbf expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.042958:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3ad830d, rc 0) 00000100:00100000:1.0:1784184783.042994:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f4905f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+7:5773:x1870853265425024:12345-0@lo:101: Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184783.042999:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784184783.043307:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425024:0@lo:101: 00010000:00010000:0.0:1784184783.043319:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000d53454b2/0x63160f6fbe8afcbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.043326:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000d53454b2/0x63160f6fbe8afcbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184783.043375:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784184783.043388:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000d53454b2/0x63160f6fbe8afcbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.043406:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000d53454b2/0x63160f6fbe8afcbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184783.043413:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784184783.043416:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784184783.043421:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b5f85958000 10000000:01000000:0.0:1784184783.043423:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784184783.043426:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784184783.043427:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784184783.043444:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.043450:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.043457:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.043469:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425152:0@lo:101: 00000100:00100000:0.0:1784184783.044473:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.044593:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000098c49be going to sleep for 11 seconds 00000100:00100000:3.0:1784184783.044679:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425152 00000100:00100000:3.0:1784184783.044686:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425152 00000100:00100000:3.0:1784184783.044734:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784184783.044742:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007880de98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+7:5773:x1870853265425152:12345-0@lo:101: 00010000:00010000:3.0:1784184783.044756:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184783.044770:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afccd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184783.044791:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184783.044800:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184783.044821:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002592ce53, rc 0) 00000100:00100000:3.0:1784184783.044862:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007880de98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:5773:x1870853265425152:12345-0@lo:101: Request processed in 122us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184783.044868:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784184783.044952:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425152:0@lo:101: 00010000:00010000:0.0:1784184783.044967:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.044973:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.045038:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425280:0@lo:501: 00000100:00100000:0.0:1784184783.045065:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.045134:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000098c49be going to sleep for 11 seconds 00000100:00100000:1.0:1784184783.046451:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425280 00000100:00100000:1.0:1784184783.046461:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425280 00000100:00100000:3.0:1784184783.046628:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784184783.046637:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f077203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:5773:x1870853265425280:12345-0@lo:501: 00000100:00100000:3.0:1784184783.046916:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f077203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5773:x1870853265425280:12345-0@lo:501: Request processed in 280us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184783.046924:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784184783.046950:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425280:0@lo:501: 00000100:00100000:0.0:1784184783.046995:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425408:0@lo:503: 00000100:00100000:0.0:1784184783.047037:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.047070:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000098c49be going to sleep for 11 seconds 00000100:00100000:2.0:1784184783.047230:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425408 00000100:00100000:2.0:1784184783.047236:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425408 00000100:00100000:2.0:1784184783.047263:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784184783.047268:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075157a62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5773:x1870853265425408:12345-0@lo:503: 00000100:00100000:2.0:1784184783.047427:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075157a62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5773:x1870853265425408:12345-0@lo:503: Request processed in 159us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.047433:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784184783.047564:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425408:0@lo:503: 00000100:00100000:0.0:1784184783.051540:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5815:1870853265425536:0@lo:502: 00000100:00100000:0.0:1784184783.051642:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.051739:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d785065d going to sleep for 11 seconds 00000100:00100000:1.0:1784184783.052002:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425536 00000100:00100000:1.0:1784184783.052010:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425536 00000100:00100000:2.0:1784184783.057618:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784184783.057638:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086a829ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5815:x1870853265425536:12345-0@lo:502: 00000100:00100000:2.0:1784184783.058181:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086a829ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5815:x1870853265425536:12345-0@lo:502: Request processed in 486us (6473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.058190:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784184783.059311:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038f65042 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5815:1870853265425536:0@lo:502: 00000020:01000000:1.0:1784184783.059403:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784184783.059417:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784184783.059420:0:5815:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784184783.059426:0:5815:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784184783.059430:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784184783.059447:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c6eff652) 00000020:00000080:1.0:1784184783.059467:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784184783.059472:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784184783.059646:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784184783.059655:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8afce2 00000020:00000080:0.0:1784184783.060054:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784184783.060060:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784184783.060065:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184783.060066:0:5815:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784184783.060069:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784184783.060073:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184783.060074:0:5815:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784184783.060077:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784184783.060093:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000044510f0a) 00000020:00000080:0.0:1784184783.060104:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784184783.060109:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784184783.060110:0:5815:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784184783.060113:0:5815:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784184783.060202:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784184783.060378:0:5815:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000036e8951f from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784184783.060391:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002ce25faf) 00000020:00000080:0.0:1784184783.060400:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784184783.060449:0:5815:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784184783.060455:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8afcf7 00000020:00000080:0.0:1784184783.060561:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784184783.060568:0:5815:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784184783.060572:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x63160f6fbe8afcfe 00080000:01000000:0.0:1784184783.060576:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784184783.060579:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8afd05 00080000:10000000:0.0:1784184783.062539:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1784184783.062809:0:5815:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1784184783.072027:0:5815:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1784184783.209093:0:5815:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1784184783.209592:0:5815:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1784184783.222232:0:5815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784184783.226004:0:5815:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784184783.283775:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001e98e406) 00000020:00000080:1.0:1784184783.283796:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1784184783.283863:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784184783.283870:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8afd13 00000020:00000080:0.0:1784184783.291721:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1784184783.292964:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1784184783.345521:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1784184783.371572:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1784184783.386908:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784184783.478461:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784184783.526658:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784184783.561527:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1784184783.589949:0:5815:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x63160f6fbe8afd1a 00000020:00000080:2.0:1784184783.590370:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784184783.590382:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184783.590387:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184783.590390:0:5815:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784184783.590393:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784184783.590399:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184783.590400:0:5815:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784184783.590405:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784184783.590440:0:5815:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784184783.590456:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184783.590458:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184783.590460:0:5815:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784184783.590462:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784184783.590464:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184783.590465:0:5815:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784184783.590468:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784184783.590469:0:5815:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784184783.590527:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000798fb44 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5815:1870853265425664:0@lo:502: 00000100:00100000:2.0:1784184783.590622:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184783.590672:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a269a3ed going to sleep for 11 seconds 00000100:00100000:0.0:1784184783.590789:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425664 00000100:00100000:0.0:1784184783.590796:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425664 00000100:00100000:0.0:1784184783.590832:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784184783.590839:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e40e022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5815:x1870853265425664:12345-0@lo:502: 00000100:00100000:0.0:1784184783.592352:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e40e022 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5815:x1870853265425664:12345-0@lo:502: Request processed in 1484us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184783.592365:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784184783.592492:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000798fb44 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5815:1870853265425664:0@lo:502: 00000020:01000000:3.0:1784184783.592527:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784184783.592534:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184783.592550:0:5815:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784184783.592555:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1784184783.592757:0:5773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1784184783.592774:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784184783.592796:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.592807:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184783.592831:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5f85958000 from 1 10000000:01000000:0.0:1784184783.592834:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784184783.592865:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.592871:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.592879:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.592894:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425792:0@lo:101: 00000100:00100000:0.0:1784184783.592930:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.593107:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a891ba1 going to sleep for 11 seconds 00000100:00100000:1.0:1784184783.593148:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425792 00000100:00100000:1.0:1784184783.593221:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425792 00000100:00100000:1.0:1784184783.593287:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784184783.593294:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a98b6365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:5773:x1870853265425792:12345-0@lo:101: 00010000:00010000:1.0:1784184783.593306:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184783.593318:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afd21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.593365:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.593387:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.593395:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f74ae9b5, rc 0) 00000100:00100000:1.0:1784184783.593472:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a98b6365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:5773:x1870853265425792:12345-0@lo:101: Request processed in 178us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184783.593479:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784184783.593669:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425792:0@lo:101: 00010000:00010000:0.0:1784184783.593688:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.593698:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.594308:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425920:0@lo:256: 00000100:00100000:0.0:1784184783.594551:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.594657:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a891ba1 going to sleep for 11 seconds 00000100:00100000:1.0:1784184783.594724:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265425920 00000100:00100000:1.0:1784184783.594731:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265425920 00000100:00100000:1.0:1784184783.594816:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784184783.594825:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8157856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:5773:x1870853265425920:12345-0@lo:256: 20000000:01000000:1.0:1784184783.594842:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784184783.594848:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784184783.594924:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8157856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:5773:x1870853265425920:12345-0@lo:256: Request processed in 101us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184783.594931:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784184783.595036:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265425920:0@lo:256: 10000000:01000000:0.0:1784184783.595650:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784184783.595672:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.595692:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184783.595700:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5f85958000 from 1 10000000:01000000:0.0:1784184783.595703:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784184783.595730:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.595737:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.595746:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.595760:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426048:0@lo:101: 00000100:00100000:0.0:1784184783.595795:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.595809:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a891ba1 going to sleep for 11 seconds 00000100:00100000:2.0:1784184783.595949:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426048 00000100:00100000:2.0:1784184783.595954:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426048 00000100:00100000:2.0:1784184783.595977:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784184783.595982:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049f56727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:5773:x1870853265426048:12345-0@lo:101: 00010000:00010000:2.0:1784184783.595998:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184783.596009:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afd2f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.596026:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.596035:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.596042:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a7197a5, rc 0) 00000100:00100000:2.0:1784184783.596079:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049f56727 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5773:x1870853265426048:12345-0@lo:101: Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.596085:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784184783.596170:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426048:0@lo:101: 00010000:00010000:0.0:1784184783.596181:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.596187:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.596231:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426176:0@lo:501: 00000100:00100000:0.0:1784184783.596254:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.596279:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a891ba1 going to sleep for 11 seconds 00000100:00100000:2.0:1784184783.596370:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426176 00000100:00100000:2.0:1784184783.596375:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426176 00000100:00100000:2.0:1784184783.596391:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784184783.596396:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aef3b665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5773:x1870853265426176:12345-0@lo:501: 00000100:00100000:2.0:1784184783.596939:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aef3b665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5773:x1870853265426176:12345-0@lo:501: Request processed in 542us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.596946:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784184783.597047:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426176:0@lo:501: 00000100:00100000:0.0:1784184783.597077:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426304:0@lo:503: 00000100:00100000:0.0:1784184783.597111:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.597137:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a891ba1 going to sleep for 11 seconds 00000100:00100000:2.0:1784184783.597237:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426304 00000100:00100000:2.0:1784184783.597242:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426304 00000100:00100000:2.0:1784184783.597260:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784184783.597265:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051d499f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5773:x1870853265426304:12345-0@lo:503: 00000040:00080000:2.0:1784184783.597295:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784184783.597359:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051d499f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5773:x1870853265426304:12345-0@lo:503: Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.597374:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784184783.597442:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426304:0@lo:503: 00000040:00080000:0.0:1784184783.598618:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1784184783.598799:0:5773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1784184783.598818:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784184783.598872:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.598883:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184783.598928:0:5773:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784184783.598931:0:5773:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b5f85958000 10000000:01000000:1.0:1784184783.598934:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b5f85958000 10000000:01000000:1.0:1784184783.598938:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784184783.598954:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5f85958000 from 1 10000000:01000000:1.0:1784184783.598957:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784184783.598987:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.598996:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184783.599005:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184783.599022:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000390fd095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426432:0@lo:101: 00000100:00100000:1.0:1784184783.599079:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184783.599121:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afb0fab2 going to sleep for 11 seconds 00000100:00100000:3.0:1784184783.599190:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426432 00000100:00100000:3.0:1784184783.599198:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426432 00000100:00100000:3.0:1784184783.599287:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784184783.599296:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a618b220 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5773:x1870853265426432:12345-0@lo:101: 00010000:00010000:3.0:1784184783.599309:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184783.599324:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afd3d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184783.599545:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184783.599568:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184783.599576:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008aac89cc, rc 0) 00000100:00100000:3.0:1784184783.599620:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a618b220 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5773:x1870853265426432:12345-0@lo:101: Request processed in 326us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184783.599627:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784184783.599698:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000390fd095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426432:0@lo:101: 00010000:00010000:0.0:1784184783.599714:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.599723:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.599774:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426560:0@lo:501: 00000100:00100000:0.0:1784184783.599800:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.599959:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f66dadc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184783.600012:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426560 00000100:00100000:1.0:1784184783.600017:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426560 00000100:00100000:0.0:1784184783.600078:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784184783.600083:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000091dee65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5773:x1870853265426560:12345-0@lo:501: 00000100:00100000:0.0:1784184783.600353:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000091dee65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5773:x1870853265426560:12345-0@lo:501: Request processed in 269us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184783.600360:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784184783.600478:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008ff9326e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426560:0@lo:501: 00000100:00100000:1.0:1784184783.600508:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426688:0@lo:503: 00000100:00100000:1.0:1784184783.600555:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184783.600581:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 0000000010e8814f going to sleep for 11 seconds 00000100:00100000:0.0:1784184783.600624:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426688 00000100:00100000:0.0:1784184783.600629:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426688 00000100:00100000:0.0:1784184783.600646:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784184783.600651:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf248c27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5773:x1870853265426688:12345-0@lo:503: 00000100:00100000:0.0:1784184783.600995:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf248c27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5773:x1870853265426688:12345-0@lo:503: Request processed in 344us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184783.601008:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784184783.601137:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265426688:0@lo:503: 00000100:00100000:1.0:1784184783.601592:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5820:1870853265426816:0@lo:502: 00000100:00100000:1.0:1784184783.601629:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184783.601658:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a410f7f9 going to sleep for 11 seconds 00000100:00100000:0.0:1784184783.601701:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426816 00000100:00100000:0.0:1784184783.601705:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426816 00000100:00100000:0.0:1784184783.601766:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784184783.601772:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021d9157a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5820:x1870853265426816:12345-0@lo:502: 00000100:00100000:0.0:1784184783.601962:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021d9157a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5820:x1870853265426816:12345-0@lo:502: Request processed in 191us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184783.601969:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784184783.602035:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5820:1870853265426816:0@lo:502: 00000020:01000004:1.0:1784184783.602083:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784184783.602098:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000736f29b6) 00000020:00000080:1.0:1784184783.602116:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1784184783.603895:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000036e8951f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784184783.603905:0:5820:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000036e8951f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784184783.603908:0:5820:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000036e8951f 4 00010000:00080000:1.0:1784184783.603941:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000998df03b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1784184783.607681:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1784184783.607791:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784184783.607829:0:5820:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784184783.607844:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x63160f6fbe8afd52 00000100:00080000:1.0:1784184783.607857:0:5820:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784184783.607863:0:5820:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000998df03b using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1784184783.607903:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f9edcfe2 x1870853265426944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784184783.607977:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265426944:0@lo:38: 00000100:00100000:2.0:1784184783.608043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784184783.608100:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784184783.610799:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082e53afc pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5820:1870853265427072:0@lo:502: 00000100:00100000:1.0:1784184783.610881:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184783.610926:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f4525ad going to sleep for 11 seconds 00000100:00100000:3.0:1784184783.611215:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265426944 00000100:00100000:3.0:1784184783.611224:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265426944 00000100:00100000:3.0:1784184783.611270:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784184783.611277:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031e74ad0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1870853265426944:12345-0@lo:38: 00000100:00100000:3.0:1784184783.611466:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031e74ad0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1870853265426944:12345-0@lo:38: Request processed in 188us (3423us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784184783.611474:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784184783.611508:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427072 00000100:00100000:3.0:1784184783.611512:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427072 00000100:00100000:3.0:1784184783.611549:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784184783.611556:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4459170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5820:x1870853265427072:12345-0@lo:502: 00000100:00100000:3.0:1784184783.611790:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4459170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5820:x1870853265427072:12345-0@lo:502: Request processed in 235us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184783.611797:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784184783.611849:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082e53afc pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5820:1870853265427072:0@lo:502: 00000040:00080000:3.0:1784184783.611879:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1784184783.612315:0:5773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1784184783.612374:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784184783.612386:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184783.612397:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784184783.612438:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784184783.612440:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784184783.612441:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784184783.612442:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784184783.612444:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784184783.612445:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784184783.612447:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784184783.612448:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784184783.612449:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784184783.612450:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784184783.612452:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784184783.612453:0:5773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784184783.612457:0:5773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1784184783.612459:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784184783.612460:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784184783.612461:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784184783.612470:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784184783.612471:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784184783.612472:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784184783.612473:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784184783.612474:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784184783.612474:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784184783.612475:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784184783.612476:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784184783.612477:0:5773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784184783.612497:0:5773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784184783.612509:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0187964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265427200:0@lo:253: 00000100:00100000:0.0:1784184783.612556:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184783.612584:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a891ba1 going to sleep for 11 seconds 00000100:00100000:3.0:1784184783.613271:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427200 00000100:00100000:3.0:1784184783.613278:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427200 00000100:00100000:3.0:1784184783.613320:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784184783.613350:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050f09b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5773:x1870853265427200:12345-0@lo:253: 20000000:01000000:3.0:1784184783.613383:0:5787:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784184783.613397:0:5787:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1784184783.614480:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784184783.614492:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000998df03b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784184783.614498:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784184783.614502:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265426944:0@lo:38: 20000000:01000000:0.0:1784184783.642861:0:5787:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784184783.642883:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784184783.642952:0:5808:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784184783.642958:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784184783.642980:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.642998:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643006:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643044:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643057:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 12 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184783.643069:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047f8f45b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1870853265427328:0@lo:104: 00000100:00100000:2.0:1784184783.643131:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184783.643185:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b51f5a24 going to sleep for 11 seconds 00000100:00100000:2.0:1784184783.643211:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427328 00000100:00100000:2.0:1784184783.643218:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427328 00000100:00100000:2.0:1784184783.643255:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784184783.643262:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b07ba330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5808:x1870853265427328:12345-0@lo:104: 00010000:00010000:2.0:1784184783.643272:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643356:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784184783.643361:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b07ba330 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5808:x1870853265427328:12345-0@lo:104: Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.643368:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784184783.643391:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784184783.643395:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643402:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000368262d already unused, calling callback (00000000396629dd) 10000000:00010000:2.0:1784184783.643404:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643411:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784184783.643416:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184783.643422:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784184783.643446:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643452:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784184783.643464:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643469:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 000000000368262d/0x63160f6fbe8afd21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd28 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643495:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184783.643497:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184783.643498:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184783.643566:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9db7b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265427456:0@lo:103: 00000100:00100000:2.0:1784184783.643593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184783.643650:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427456 00000100:00100000:2.0:1784184783.643654:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427456 00010000:00010000:2.0:1784184783.643666:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 13 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184783.643685:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784184783.643689:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bea36d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3314:x1870853265427456:12345-0@lo:103: 00010000:00010000:2.0:1784184783.643697:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184783.643701:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 13 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643710:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 13 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643724:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643730:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784184783.643741:0:5777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000784940s 00010000:00010000:2.0:1784184783.643744:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643759:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643765:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643770:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643775:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000985e80df already unused, calling callback (00000000b55e7716) 00010000:00010000:2.0:1784184783.643778:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643784:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643792:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643800:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184783.643825:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bea36d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3314:x1870853265427456:12345-0@lo:103: Request processed in 137us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184783.643832:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784184783.643862:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9db7b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265427456:0@lo:103: 00010000:00010000:2.0:1784184783.643887:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f74ae9b5/0x63160f6fbe8afd28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afd21 expref: 12 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184783.643897:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047f8f45b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1870853265427328:0@lo:104: 00010000:00010000:2.0:1784184783.643907:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643921:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643926:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184783.643931:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000985e80df/0x63160f6fbe8afd59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184783.652626:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050f09b22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5773:x1870853265427200:12345-0@lo:253: Request processed in 39291us (40062us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184783.652642:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784184783.652721:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0187964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5773:1870853265427200:0@lo:253: 10000000:01000000:2.0:1784184783.652735:0:5773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784184783.652738:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784184783.652740:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784184783.652741:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784184783.652742:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784184783.652744:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784184783.652745:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784184783.652746:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784184783.652748:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784184783.652749:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784184783.652750:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784184783.652752:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784184783.652753:0:5773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784184783.652770:0:5773:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784184783.657316:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1784184783.657789:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784184783.657965:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1784184783.658121:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784184783.658283:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1784184783.658461:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1784184783.659625:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1784184783.659813:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1784184783.659989:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1784184783.660129:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1784184783.660420:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1784184783.660603:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1784184783.691525:0:5773:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1784184783.717884:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1784184783.718028:0:5825:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1784184783.718033:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1784184783.718147:0:5826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784184783.721776:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784184783.721985:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784184783.724434:0:5773:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784184783.731869:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784184783.732220:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784184783.733274:0:5773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784184783.733905:0:5773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784184783.733940:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784184783.734219:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784184783.734446:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1784184783.743020:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1784184783.743184:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1784184783.743323:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1784184783.743495:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784184783.743644:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1784184783.743794:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784184783.743927:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784184783.744082:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784184783.744228:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784184783.744415:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784184783.744584:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784184783.744750:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784184783.744879:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784184783.745031:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784184783.745162:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784184783.745306:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1784184783.747898:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1784184783.748130:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1784184783.749404:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1784184783.749616:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1784184783.749770:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1784184783.749923:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1784184783.750058:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1784184783.750197:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1784184783.750369:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1784184783.750528:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1784184783.750678:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1784184783.750821:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1784184783.750957:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1784184783.751097:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1784184783.751230:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1784184783.751401:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1784184783.756468:0:5773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1784184783.769631:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1784184783.809098:0:5773:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784184783.809144:0:5773:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac49c183b988 00100000:10000000:3.0:1784184783.809167:0:5773:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1784184783.813650:0:5773:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784184783.813669:0:5773:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784184783.813683:0:5773:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784184783.813710:0:5773:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1784184783.866088:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784184783.866182:0:5826:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784184783.866186:0:5826:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1784184784.395093:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184785.418469:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184786.446058:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184787.466489:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184788.491849:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784184788.584909:0:6069:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1784184788.683630:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265427584:0@lo:400: 00000100:00100000:2.0:1784184788.683704:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784184788.683787:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784184788.683793:0:1384:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784184788.683795:0:1384:0:(import.c:65:import_set_state_nolock()) 00000000998df03b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784184788.683805:0:1384:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000998df03b using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1784184788.683829:0:1384:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b198c303 x1870853265427712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784184788.683865:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b198c303 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265427712:0@lo:38: 00000100:00100000:1.0:1784184788.683898:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184788.683986:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427584 00000100:00100000:3.0:1784184788.683995:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427584 00000100:00100000:3.0:1784184788.684043:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784184788.684052:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088a9a34a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:3315:x1870853265427584:12345-0@lo:400: 00000100:00100000:3.0:1784184788.684646:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088a9a34a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:3315:x1870853265427584:12345-0@lo:400: Request processed in 594us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184788.684656:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784184788.684721:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9edcfe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265427584:0@lo:400: 00000100:00100000:2.0:1784184788.684753:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427712 00000100:00100000:2.0:1784184788.684758:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427712 00000100:00100000:2.0:1784184788.684821:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784184788.684825:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000519b0cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1870853265427712:12345-0@lo:38: 00010000:00080000:2.0:1784184788.684848:0:5794:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1784184788.684881:0:5794:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x63160f6fbe8afd60 00000004:00100000:2.0:1784184788.684921:0:5794:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784184788.685059:0:5794:0:(import.c:65:import_set_state_nolock()) 0000000058cdebd6 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784184788.685130:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000519b0cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870853265427712:12345-0@lo:38: Request processed in 303us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184788.685137:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784184788.685206:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b198c303 x1870853265427712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784184798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784184788.685231:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784184788.685238:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784184788.685243:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784184788.685245:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000998df03b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784184788.685251:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b198c303 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265427712:0@lo:38: 00010000:00010000:2.0:1784184789.515418:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184790.540977:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184791.562559:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184792.586443:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784184792.809528:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784184792.809535:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5f85958000 from 3 10000000:01000000:1.0:1784184792.809540:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784184792.809584:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000809bcea5/0x63160f6fbe8afd67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184792.809602:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000809bcea5/0x63160f6fbe8afd67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184792.809613:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000809bcea5/0x63160f6fbe8afd67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184792.809636:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000744b5902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265427840:0@lo:101: 00000100:00100000:1.0:1784184792.809704:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184792.809759:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f87f854 going to sleep for 11 seconds 00000100:00100000:0.0:1784184792.809811:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427840 00000100:00100000:0.0:1784184792.809830:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427840 00000100:00100000:0.0:1784184792.809884:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784184792.809892:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce550d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5789:x1870853265427840:12345-0@lo:101: 00010000:00010000:0.0:1784184792.809906:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184792.809922:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea8060df/0x63160f6fbe8afd6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afd67 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184792.809944:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea8060df/0x63160f6fbe8afd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184792.809954:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea8060df/0x63160f6fbe8afd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184792.809971:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea8060df, rc 0) 00000100:00100000:0.0:1784184792.810462:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce550d92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265427840:12345-0@lo:101: Request processed in 569us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184792.810470:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784184792.814397:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000744b5902 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265427840:0@lo:101: 00010000:00010000:3.0:1784184792.814428:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000809bcea5/0x63160f6fbe8afd67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184792.814448:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000809bcea5/0x63160f6fbe8afd67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184792.814514:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1a38d11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265427968:0@lo:256: 00000100:00100000:3.0:1784184792.814583:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184792.814649:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f1eff456 going to sleep for 11 seconds 00000100:00100000:2.0:1784184792.814940:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265427968 00000100:00100000:2.0:1784184792.814948:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265427968 00000100:00100000:2.0:1784184792.815006:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784184792.815014:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f8c6c0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265427968:12345-0@lo:256: 20000000:01000000:2.0:1784184792.815034:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784184792.815051:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784184792.815053:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1784184792.815160:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f8c6c0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265427968:12345-0@lo:256: Request processed in 146us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184792.815167:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784184792.815211:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1a38d11 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265427968:0@lo:256: 10000000:01000000:0.0:1784184792.815254:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784184792.815260:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000809bcea5/0x63160f6fbe8afd67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184792.815269:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000809bcea5/0x63160f6fbe8afd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184793.610892:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184793.803539:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d269b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265428224:0@lo:400: 00000100:00100000:1.0:1784184793.803623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184793.803701:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428224 00000100:00100000:1.0:1784184793.803709:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428224 00000100:00100000:1.0:1784184793.803752:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784184793.803760:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae919d51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265428224:12345-0@lo:400: 00000100:00100000:1.0:1784184793.803811:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae919d51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265428224:12345-0@lo:400: Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184793.803819:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784184793.803857:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007d269b0a x1870853265428224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184793.803871:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d269b0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265428224:0@lo:400: 00000100:00100000:3.0:1784184793.804145:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000943d64c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265428096:0@lo:400: 00000100:00100000:3.0:1784184793.804182:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184793.804328:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428096 00000100:00100000:1.0:1784184793.804346:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428096 00000100:00100000:1.0:1784184793.804428:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784184793.804435:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b98511c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3316:x1870853265428096:12345-0@lo:400: 00000100:00100000:1.0:1784184793.804479:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b98511c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3316:x1870853265428096:12345-0@lo:400: Request processed in 45us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184793.804486:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784184793.804565:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000943d64c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265428096:0@lo:400: 00000020:00000080:1.0:1784184794.001162:0:6270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1a2bcc50 20000000:00000080:1.0:1784184794.001180:0:6270:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b5fb8164800 uarg=0000000000000000 20000000:01000000:1.0:1784184794.001270:0:6270:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784184794.001277:0:6270:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784184794.001282:0:6270:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784184794.001566:0:6270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1784184794.001578:0:6270:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1784184794.018411:0:6270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784184794.018658:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784184794.018715:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1784184794.018767:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1784184794.018781:0:6270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784184794.019128:0:6270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184794.019145:0:6270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184794.019150:0:6270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184794.019182:0:6270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184794.019191:0:6270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 11 pid: 5786 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184794.019211:0:6270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000943d64c8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6270:1870853265428352:0@lo:104: 00000100:00100000:1.0:1784184794.019258:0:6270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184794.019300:0:6270:0:(client.c:2702:ptlrpc_set_wait()) set 00000000765bc522 going to sleep for 11 seconds 00000100:00100000:2.0:1784184794.019304:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428352 00000100:00100000:2.0:1784184794.019311:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428352 00000100:00100000:2.0:1784184794.019394:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784184794.019402:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d269b0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:6270:x1870853265428352:12345-0@lo:104: 00010000:00010000:2.0:1784184794.019414:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184794.019620:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784184794.019626:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d269b0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:6270:x1870853265428352:12345-0@lo:104: Request processed in 225us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184794.019634:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1784184794.019689:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784184794.019695:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.019703:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c711d810 already unused, calling callback (00000000396629dd) 10000000:00010000:0.0:1784184794.019706:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.019713:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184794.019719:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184794.019725:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784184794.019768:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.019774:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784184794.019794:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.019800:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000c711d810/0x63160f6fbe8afd2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd36 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.019813:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184794.019814:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184794.019816:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184794.019861:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7a2cafc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265428480:0@lo:103: 00000100:00100000:2.0:1784184794.019890:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184794.019969:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428480 00000100:00100000:0.0:1784184794.019975:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428480 00010000:00010000:0.0:1784184794.019994:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 12 pid: 5786 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184794.020029:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784184794.020036:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047f8f45b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3314:x1870853265428480:12345-0@lo:103: 00010000:00010000:0.0:1784184794.020046:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184794.020050:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 12 pid: 5786 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020060:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 12 pid: 5786 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020085:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020092:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020110:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020116:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020120:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020125:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020130:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e5a9f12 already unused, calling callback (00000000b55e7716) 00010000:00010000:0.0:1784184794.020133:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020139:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020146:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020154:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184794.020195:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047f8f45b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3314:x1870853265428480:12345-0@lo:103: Request processed in 159us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184794.020201:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784184794.020241:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7a2cafc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265428480:0@lo:103: 00010000:00010000:3.0:1784184794.020608:0:6270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a7197a5/0x63160f6fbe8afd36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afd2f expref: 11 pid: 5786 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184794.020619:0:6270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000943d64c8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6270:1870853265428352:0@lo:104: 00010000:00010000:3.0:1784184794.020632:0:6270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020713:0:6270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020720:0:6270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184794.020733:0:6270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e5a9f12/0x63160f6fbe8afd75 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184794.634522:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184795.658604:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184796.685276:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184797.719489:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184798.731416:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184798.924713:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9db7b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265428608:0@lo:400: 00000100:00100000:2.0:1784184798.924786:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184798.924846:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784184798.924853:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3466fcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265428736:0@lo:400: 00000100:00100000:2.0:1784184798.924878:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184798.924924:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428608 00000100:00100000:2.0:1784184798.924931:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428608 00000100:00100000:2.0:1784184798.924972:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784184798.924980:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7ac5e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:3315:x1870853265428608:12345-0@lo:400: 00000100:00100000:2.0:1784184798.925029:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7ac5e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:3315:x1870853265428608:12345-0@lo:400: Request processed in 50us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184798.925036:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784184798.925066:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428736 00000100:00100000:2.0:1784184798.925070:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428736 00000100:00100000:2.0:1784184798.925095:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784184798.925101:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028aa4436 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265428736:12345-0@lo:400: 00000100:00100000:2.0:1784184798.925129:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028aa4436 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265428736:12345-0@lo:400: Request processed in 30us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184798.925134:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784184798.925168:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b3466fcd x1870853265428736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184798.925180:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3466fcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265428736:0@lo:400: 00000100:00100000:2.0:1784184798.925187:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9db7b0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265428608:0@lo:400: 00000020:01000004:3.0:1784184799.498378:0:6585:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784184799.498382:0:6585:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1784184799.498473:0:6585:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004165d67b 00000020:01000004:3.0:1784184799.498486:0:6585:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784184799.498495:0:6585:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784184799.498505:0:6585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000e242541c) 00000020:00000080:3.0:1784184799.498517:0:6585:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784184799.511038:0:6585:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784184799.511236:0:6585:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1784184799.530521:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784184799.534779:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784184799.534801:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784184799.534834:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784184799.534848:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784184799.535164:0:6585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784184799.535174:0:6585:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784184799.535186:0:6585:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63160f6fbe8afd83 00000020:01000004:2.0:1784184799.535193:0:6585:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784184799.535209:0:6585:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784184799.535211:0:6585:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784184799.535217:0:6585:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784184799.535221:0:6585:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784184799.535230:0:6585:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000006e4fd918) 00000020:00000080:2.0:1784184799.535239:0:6585:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1784184799.536265:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784184799.536416:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784184799.536420:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784184799.537042:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784184799.537048:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784184799.537616:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784184799.537623:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784184799.539489:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784184799.539636:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784184799.539642:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1784184799.540743:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1784184799.540751:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784184799.563035:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784184799.563292:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784184799.563299:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784184799.564445:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784184799.564454:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784184799.565721:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784184799.565733:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784184799.567855:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784184799.568025:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784184799.568032:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784184799.568800:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784184799.568808:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784184799.643571:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784184799.643829:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784184799.643843:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784184799.645441:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784184799.645456:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784184799.645944:0:6585:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784184799.645971:0:6585:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1784184799.645978:0:6585:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784184799.677975:0:6585:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784184799.678005:0:6585:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1784184799.678008:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784184799.678009:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784184799.678010:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784184799.678011:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784184799.678012:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784184799.678012:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784184799.678013:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784184799.678014:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784184799.678018:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784184799.678019:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784184799.678019:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784184799.678022:0:6585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1784184799.678023:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784184799.678024:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784184799.678025:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784184799.678025:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784184799.678026:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784184799.678026:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784184799.678027:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784184799.678027:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784184799.678028:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784184799.678028:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784184799.678029:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784184799.678463:0:6585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784184799.678482:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9db7b0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265428864:0@lo:253: 00000100:00100000:2.0:1784184799.678557:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184799.678666:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000008652b581 going to sleep for 11 seconds 00000100:00100000:1.0:1784184799.681832:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428864 00000100:00100000:1.0:1784184799.681845:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428864 00000100:00100000:1.0:1784184799.681998:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184799.682006:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ef86c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265428864:12345-0@lo:253: 20000000:01000000:1.0:1784184799.682063:0:5787:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784184799.682067:0:5787:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1784184799.682070:0:5787:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1784184799.682072:0:5787:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1784184799.682962:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784184799.683096:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1784184799.683106:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1784184799.683138:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1784184799.683146:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1784184799.683178:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1784184799.683233:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1784184799.684006:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1784184799.684023:0:5787:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:1.0:1784184799.684025:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:1.0:1784184799.684107:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1784184799.684116:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784184799.684163:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1784184799.684173:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:1.0:1784184799.684208:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1784184799.684217:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1784184799.684264:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1784184799.684480:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1784184799.689901:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1784184799.689939:0:5787:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:0.0:1784184799.689941:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:0.0:1784184799.689985:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1784184799.689993:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784184799.690022:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1784184799.690028:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:0.0:1784184799.690154:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1784184799.690164:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784184799.690191:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1784184799.690225:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1784184799.690244:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1784184799.690246:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1784184799.690252:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784184799.690254:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784184799.690256:0:5787:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784184799.690268:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784184799.690468:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784184799.690509:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784184799.690512:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784184799.691210:0:6601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784184799.691399:0:6601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784184799.691461:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1784184799.691786:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1784184799.691833:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1784184799.691887:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1784184799.691899:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784184799.691911:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784184799.692604:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1784184799.692919:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1784184799.692962:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1784184799.693026:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1784184799.693115:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784184799.693118:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784184799.693712:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1784184799.693838:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1784184799.693889:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1784184799.694215:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1784184799.694255:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1784184799.694574:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:2.0:1784184799.694593:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784184799.694609:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.694628:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.694635:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.694650:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.694656:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.694695:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.694709:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 11 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.694792:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3466fcd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5787:1870853265428992:0@lo:104: 00000100:00100000:2.0:1784184799.694855:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784184799.694964:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.694972:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 11 pid: 5787 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.694979:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003b71f297 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5787:1870853265429120:0@lo:104: 00000100:00100000:2.0:1784184799.695002:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784184799.695169:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.695177:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 11 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.695185:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e015d776 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5787:1870853265429248:0@lo:104: 00000100:00100000:2.0:1784184799.695215:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.695267:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265428992 00000100:00100000:1.0:1784184799.695287:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265428992 00000100:00100000:1.0:1784184799.695324:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265429120 00000100:00100000:1.0:1784184799.695327:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265429120 00000100:00100000:1.0:1784184799.695371:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784184799.695378:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011948a95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:5787:x1870853265428992:12345-0@lo:104: 00010000:00010000:1.0:1784184799.695390:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695440:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784184799.695445:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011948a95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:5787:x1870853265428992:12345-0@lo:104: Request processed in 68us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.695453:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784184799.695470:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784184799.695475:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000371a3626 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5787:x1870853265429120:12345-0@lo:104: 00010000:00010000:1.0:1784184799.695482:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695515:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784184799.695520:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000371a3626 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5787:x1870853265429120:12345-0@lo:104: Request processed in 45us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.695536:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1784184799.695555:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784184799.695559:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695566:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c613fe4d already unused, calling callback (00000000396629dd) 10000000:00010000:1.0:1784184799.695569:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695576:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184799.695583:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184799.695588:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784184799.695615:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695620:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184799.695635:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695642:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd44 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695653:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784184799.695656:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695671:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000080b7885f already unused, calling callback (00000000396629dd) 10000000:00010000:1.0:1784184799.695673:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695679:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184799.695684:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184799.695689:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784184799.695702:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695707:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184799.695712:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695716:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 0000000080b7885f/0x63160f6fbe8afccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afcd4 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695737:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184799.695739:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184799.695740:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184799.695760:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265429376:0@lo:103: 00000100:00100000:1.0:1784184799.695789:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.695811:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184799.695816:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fdb68d90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265429504:0@lo:103: 00000100:00100000:1.0:1784184799.695847:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.695875:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265429376 00000100:00100000:1.0:1784184799.695878:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265429376 00010000:00010000:1.0:1784184799.695894:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 12 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.695913:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265429504 00000100:00100000:1.0:1784184799.695916:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265429504 00010000:00010000:1.0:1784184799.695924:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 13 pid: 5787 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.695935:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784184799.695940:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000849d2cec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3313:x1870853265429376:12345-0@lo:103: 00010000:00010000:1.0:1784184799.695949:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184799.695953:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 13 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695961:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 13 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.695974:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184799.695998:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000849d2cec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3313:x1870853265429376:12345-0@lo:103: Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.696004:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784184799.696014:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784184799.696018:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000260226c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3313:x1870853265429504:12345-0@lo:103: 00010000:00010000:1.0:1784184799.696024:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184799.696027:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 12 pid: 5787 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.696207:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set 0000000049247642 going to sleep for 11 seconds 00010000:00010000:2.0:1784184799.696226:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008aac89cc/0x63160f6fbe8afd44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afd3d expref: 12 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.696238:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3466fcd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5787:1870853265428992:0@lo:104: 00000100:00100000:2.0:1784184799.696246:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003b71f297 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5787:1870853265429120:0@lo:104: 00010000:00010000:1.0:1784184799.696296:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 11 pid: 5787 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696307:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002592ce53/0x63160f6fbe8afcd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afccd expref: 11 pid: 5787 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696316:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184799.696378:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000260226c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:3313:x1870853265429504:12345-0@lo:103: Request processed in 360us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.696385:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784184799.696414:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fdb68d90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265429504:0@lo:103: 00000100:00100000:1.0:1784184799.696421:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265429376:0@lo:103: 00000100:00100000:1.0:1784184799.696442:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265429248 00000100:00100000:1.0:1784184799.696446:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265429248 00000100:00100000:1.0:1784184799.696462:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784184799.696466:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b4bd982 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5787:x1870853265429248:12345-0@lo:104: 00010000:00010000:1.0:1784184799.696473:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696507:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784184799.696512:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b4bd982 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5787:x1870853265429248:12345-0@lo:104: Request processed in 46us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.696517:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784184799.696529:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784184799.696531:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696549:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a31ddae1 already unused, calling callback (00000000396629dd) 10000000:00010000:1.0:1784184799.696551:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696557:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184799.696562:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184799.696566:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784184799.696586:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696592:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184799.696606:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696612:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000a31ddae1/0x63160f6fbe8afcb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afcb8 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.696624:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184799.696625:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184799.696626:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184799.696636:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265429632:0@lo:103: 00000100:00100000:1.0:1784184799.696662:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.696694:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265429632 00000100:00100000:1.0:1784184799.696698:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265429632 00010000:00010000:1.0:1784184799.696709:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 10 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.696830:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e015d776 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5787:1870853265429248:0@lo:104: 00010000:00010000:2.0:1784184799.696848:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.696954:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184799.697055:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784184799.697064:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb68d90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:3315:x1870853265429632:12345-0@lo:103: 00010000:00010000:0.0:1784184799.697072:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184799.697076:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 10 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697083:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 10 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697093:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000912b55eb/0x63160f6fbe8afcb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afcb1 expref: 10 pid: 5786 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697103:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697110:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697121:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697128:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697133:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697149:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697154:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000041f7096e already unused, calling callback (00000000b55e7716) 00010000:00010000:0.0:1784184799.697157:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697163:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697186:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.697196:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184799.697225:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb68d90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:3315:x1870853265429632:12345-0@lo:103: Request processed in 164us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184799.697231:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784184799.697293:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265429632:0@lo:103: 00010000:00010000:1.0:1784184799.697310:0:5787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.697316:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.697320:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041f7096e/0x63160f6fbe8afd91 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784184799.697347:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784184799.746617:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ef86c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:6585:x1870853265428864:12345-0@lo:253: Request processed in 64604us (68052us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.746635:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184799.746748:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9db7b0c pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265428864:0@lo:253: 10000000:01000000:1.0:1784184799.746764:0:6585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784184799.746767:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784184799.746769:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784184799.746770:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784184799.746771:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1784184799.746772:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784184799.746774:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784184799.746775:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784184799.746776:0:6585:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784184799.746778:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784184799.746779:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784184799.746800:0:6585:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004165d67b from lustre-OST0000 10000000:01000000:1.0:1784184799.746824:0:6585:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784184799.746827:0:6585:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784184799.746833:0:6585:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b5f90580000 local copy 10000000:01000000:1.0:1784184799.746838:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784184799.746872:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.747021:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.747030:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.747048:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265429760:0@lo:101: 00000100:00100000:1.0:1784184799.747084:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.747132:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009eb435e2 going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.747191:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265429760 00000100:00100000:3.0:1784184799.747197:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265429760 00000100:00100000:3.0:1784184799.747240:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784184799.747248:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df198f21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:6585:x1870853265429760:12345-0@lo:101: 00010000:00010000:3.0:1784184799.747259:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184799.747296:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6595df4/0x63160f6fbe8afd9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afd98 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184799.747317:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6595df4/0x63160f6fbe8afd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afd98 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184799.747326:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6595df4/0x63160f6fbe8afd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd98 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184799.747354:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6595df4, rc 0) 00000100:00100000:3.0:1784184799.747391:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df198f21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:6585:x1870853265429760:12345-0@lo:101: Request processed in 144us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.747397:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784184799.747515:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265429760:0@lo:101: 00010000:00010000:1.0:1784184799.747528:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.747536:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.747629:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265429888:0@lo:501: 00000100:00100000:1.0:1784184799.747653:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.747679:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009eb435e2 going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.747791:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265429888 00000100:00100000:3.0:1784184799.747796:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265429888 00000100:00100000:3.0:1784184799.747866:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784184799.747873:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4bc1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:6585:x1870853265429888:12345-0@lo:501: 00000100:00100000:3.0:1784184799.748153:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4bc1300 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:6585:x1870853265429888:12345-0@lo:501: Request processed in 280us (498us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784184799.748160:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784184799.748221:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265429888:0@lo:501: 10000000:01000000:1.0:1784184799.748234:0:6585:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784184799.748258:0:6585:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784184799.748263:0:6585:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748279:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748293:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748310:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784184799.748326:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b5fc0d20000 00010000:00010000:1.0:1784184799.748356:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784184799.748360:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748367:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c613fe4d already unused, calling callback (00000000396629dd) 10000000:00010000:1.0:1784184799.748370:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748377:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184799.748384:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184799.748389:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784184799.748406:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748411:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184799.748425:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748430:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000c613fe4d/0x63160f6fbe8afd98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x63160f6fbe8afd9f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748454:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184799.748456:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184799.748458:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184799.748469:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265430016:0@lo:103: 00000100:00100000:1.0:1784184799.748496:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.748534:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430016 00000100:00100000:1.0:1784184799.748538:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430016 00000100:00100000:1.0:1784184799.748567:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784184799.748572:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9c27cec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:3316:x1870853265430016:12345-0@lo:103: 00010000:00010000:1.0:1784184799.748581:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184799.748591:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6595df4/0x63160f6fbe8afd9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8afd98 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748603:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184799.748628:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9c27cec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:3316:x1870853265430016:12345-0@lo:103: Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.748635:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784184799.748658:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265430016:0@lo:103: 10000000:01000000:1.0:1784184799.748676:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784184799.748681:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b5f90580000 10000000:01000000:1.0:1784184799.748684:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784184799.748687:0:6585:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b5f90580000 from 1 10000000:01000000:1.0:1784184799.748689:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784184799.748705:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 000000007c31abe5/0x63160f6fbe8afda6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748711:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 000000007c31abe5/0x63160f6fbe8afda6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.748735:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 000000007c31abe5/0x63160f6fbe8afda6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.748747:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430144:0@lo:101: 00000100:00100000:1.0:1784184799.748772:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.749082:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009eb435e2 going to sleep for 11 seconds 00000100:00100000:0.0:1784184799.749259:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430144 00000100:00100000:0.0:1784184799.749264:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430144 00000100:00100000:0.0:1784184799.749308:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784184799.749314:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d32df370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:6585:x1870853265430144:12345-0@lo:101: 00010000:00010000:0.0:1784184799.749322:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184799.749354:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000368262d/0x63160f6fbe8afdad lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afda6 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.749371:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000368262d/0x63160f6fbe8afdad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afda6 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.749380:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000368262d/0x63160f6fbe8afdad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afda6 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.749395:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000368262d, rc 0) 00000100:00100000:0.0:1784184799.749434:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d32df370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:6585:x1870853265430144:12345-0@lo:101: Request processed in 120us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184799.749457:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784184799.749701:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430144:0@lo:101: 00010000:00010000:1.0:1784184799.749715:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 000000007c31abe5/0x63160f6fbe8afda6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdad expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.749733:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 000000007c31abe5/0x63160f6fbe8afda6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afdad expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184799.749750:0:6585:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784184799.749758:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 000000007c31abe5/0x63160f6fbe8afda6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdad expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.749764:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 000000007c31abe5/0x63160f6fbe8afda6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdad expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184799.749770:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784184799.749774:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784184799.749778:0:6585:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784184799.749780:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784184799.749795:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a6f4af6d/0x63160f6fbe8afdb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.749801:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000a6f4af6d/0x63160f6fbe8afdb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.749816:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000a6f4af6d/0x63160f6fbe8afdb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.749829:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430272:0@lo:101: 00000100:00100000:1.0:1784184799.749858:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.749875:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009eb435e2 going to sleep for 11 seconds 00000100:00100000:0.0:1784184799.750095:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430272 00000100:00100000:0.0:1784184799.750100:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430272 00000100:00100000:0.0:1784184799.750128:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784184799.750134:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009133d801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:6585:x1870853265430272:12345-0@lo:101: 00010000:00010000:0.0:1784184799.750141:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184799.750149:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a31ddae1/0x63160f6fbe8afdbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afdb4 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.750161:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a31ddae1/0x63160f6fbe8afdbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.750169:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a31ddae1/0x63160f6fbe8afdbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.750174:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a31ddae1, rc 0) 00000100:00100000:0.0:1784184799.750211:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009133d801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430272:12345-0@lo:101: Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184799.750217:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784184799.750327:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430272:0@lo:101: 00010000:00010000:1.0:1784184799.750366:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000a6f4af6d/0x63160f6fbe8afdb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.750373:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000a6f4af6d/0x63160f6fbe8afdb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.750455:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430400:0@lo:501: 00000100:00100000:1.0:1784184799.750483:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.750499:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009eb435e2 going to sleep for 11 seconds 00000100:00100000:0.0:1784184799.750549:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430400 00000100:00100000:0.0:1784184799.750554:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430400 00000100:00100000:0.0:1784184799.750582:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784184799.750588:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfa35204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430400:12345-0@lo:501: 00000100:00100000:0.0:1784184799.750980:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfa35204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430400:12345-0@lo:501: Request processed in 393us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184799.750993:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784184799.751062:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430400:0@lo:501: 00000100:00100000:1.0:1784184799.751092:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430528:0@lo:503: 00000100:00100000:1.0:1784184799.751129:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.751151:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009eb435e2 going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.751200:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430528 00000100:00100000:3.0:1784184799.751205:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430528 00000100:00100000:3.0:1784184799.751237:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784184799.751243:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c04366c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430528:12345-0@lo:503: 00000100:00100000:3.0:1784184799.751417:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c04366c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430528:12345-0@lo:503: Request processed in 174us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.751424:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784184799.751552:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430528:0@lo:503: 00000040:00080000:1.0:1784184799.752023:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784184799.752081:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430656:0@lo:502: 00000100:00100000:1.0:1784184799.752120:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.752190:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009eb435e2 going to sleep for 11 seconds 00000100:00100000:2.0:1784184799.752258:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430656 00000100:00100000:2.0:1784184799.752264:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430656 00000100:00100000:3.0:1784184799.752451:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784184799.752517:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009f2d4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430656:12345-0@lo:502: 00000100:00100000:1.0:1784184799.752729:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009f2d4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430656:12345-0@lo:502: Request processed in 259us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.752736:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784184799.752993:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0c5370d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430656:0@lo:502: 00000040:00080000:2.0:1784184799.753258:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784184799.753328:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1784184799.753511:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1784184799.753561:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1784184799.753602:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1784184799.753639:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1784184799.753671:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e015d776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430784:0@lo:502: 00000100:00100000:2.0:1784184799.753715:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184799.753850:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000009a8e528e going to sleep for 11 seconds 00000100:00100000:1.0:1784184799.753951:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430784 00000100:00100000:1.0:1784184799.753958:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430784 00000100:00100000:1.0:1784184799.754034:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784184799.754041:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb77545a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430784:12345-0@lo:502: 00000100:00100000:1.0:1784184799.754198:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb77545a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430784:12345-0@lo:502: Request processed in 158us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.754205:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784184799.754281:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e015d776 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430784:0@lo:502: 00000040:00080000:2.0:1784184799.754390:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784184799.754400:0:6585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1784184799.754774:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784184799.754782:0:6604:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784184799.754788:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184799.754790:0:6604:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784184799.754795:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784184799.754808:0:6604:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000195b88c5) 00000020:00000080:3.0:1784184799.754828:0:6604:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784184799.754833:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784184799.755066:0:6604:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004165d67b from lustre-OST0000, refs=2 00080000:01000000:3.0:1784184799.755074:0:6604:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784184799.755080:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63160f6fbe8afdc9 00010000:00010000:0.0:1784184799.759485:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184799.760259:0:6604:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1784184799.760658:0:6604:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784184799.763627:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784184799.764067:0:6604:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1784184799.771491:0:6604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784184799.772036:0:6604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784184799.773449:0:6604:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784184799.773460:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184799.773466:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184799.773468:0:6604:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784184799.773471:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784184799.773474:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184799.773475:0:6604:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784184799.773478:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784184799.773479:0:6604:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784184799.773522:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184799.773524:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184799.773526:0:6604:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784184799.773529:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784184799.779839:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1784184799.779901:0:6585:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784184799.779917:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a6f4af6d/0x63160f6fbe8afdb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184799.779929:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000a6f4af6d/0x63160f6fbe8afdb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184799.779937:0:6585:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fc0d20000 from 1 10000000:01000000:3.0:1784184799.779940:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784184799.779981:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000e3dd5eb9/0x63160f6fbe8afdd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184799.779989:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000e3dd5eb9/0x63160f6fbe8afdd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184799.779998:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000e3dd5eb9/0x63160f6fbe8afdd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184799.780020:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8e6a98d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430912:0@lo:101: 00000100:00100000:3.0:1784184799.780084:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184799.780122:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000001c962a68 going to sleep for 11 seconds 00000100:00100000:1.0:1784184799.780304:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265430912 00000100:00100000:1.0:1784184799.780312:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265430912 00000100:00100000:1.0:1784184799.780382:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784184799.780392:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a181f592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+10:6585:x1870853265430912:12345-0@lo:101: 00010000:00010000:1.0:1784184799.780404:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184799.780415:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c613fe4d/0x63160f6fbe8afdd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afdd0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.780436:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c613fe4d/0x63160f6fbe8afdd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.780445:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c613fe4d/0x63160f6fbe8afdd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.780453:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c613fe4d, rc 0) 00000100:00100000:1.0:1784184799.780490:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a181f592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265430912:12345-0@lo:101: Request processed in 101us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184799.780506:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784184799.781111:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8e6a98d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265430912:0@lo:101: 00010000:00010000:3.0:1784184799.781128:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000e3dd5eb9/0x63160f6fbe8afdd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184799.781136:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000e3dd5eb9/0x63160f6fbe8afdd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184799.781225:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8e6a98d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431040:0@lo:501: 00000100:00100000:3.0:1784184799.781260:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184799.781302:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000001c962a68 going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.781322:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431040 00000100:00100000:3.0:1784184799.781328:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431040 00000100:00100000:3.0:1784184799.781379:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784184799.781385:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6da657a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431040:12345-0@lo:501: 00000100:00100000:3.0:1784184799.781598:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6da657a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431040:12345-0@lo:501: Request processed in 213us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.781605:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784184799.781635:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8e6a98d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431040:0@lo:501: 00000100:00100000:3.0:1784184799.781659:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8e6a98d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431168:0@lo:503: 00000100:00100000:3.0:1784184799.781693:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184799.781707:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 000000001c962a68 going to sleep for 11 seconds 00000100:00100000:2.0:1784184799.782294:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431168 00000100:00100000:2.0:1784184799.782301:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431168 00000100:00100000:2.0:1784184799.782323:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784184799.782329:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f563616 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431168:12345-0@lo:503: 00000100:00100000:2.0:1784184799.782597:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f563616 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431168:12345-0@lo:503: Request processed in 268us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184799.782604:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784184799.782823:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8e6a98d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431168:0@lo:503: 00000040:00080000:1.0:1784184799.783150:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784184799.783212:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da651b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431296:0@lo:502: 00000100:00100000:1.0:1784184799.783257:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.783301:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 00000000356d148c going to sleep for 11 seconds 00000100:00100000:2.0:1784184799.783420:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431296 00000100:00100000:2.0:1784184799.783426:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431296 00000100:00100000:2.0:1784184799.783448:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784184799.783454:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000685afc73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431296:12345-0@lo:502: 00000100:00100000:2.0:1784184799.783624:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000685afc73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431296:12345-0@lo:502: Request processed in 170us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184799.783632:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784184799.784032:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da651b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431296:0@lo:502: 00000040:00080000:1.0:1784184799.784259:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784184799.784321:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784184799.784505:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da651b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431424:0@lo:502: 00000100:00100000:1.0:1784184799.784550:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.784630:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 00000000356d148c going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.784663:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431424 00000100:00100000:3.0:1784184799.784668:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431424 00000100:00100000:3.0:1784184799.784704:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784184799.784711:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020446bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431424:12345-0@lo:502: 00000100:00100000:3.0:1784184799.785081:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020446bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431424:12345-0@lo:502: Request processed in 370us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.785089:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784184799.785163:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da651b2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431424:0@lo:502: 00000040:00080000:1.0:1784184799.785264:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784184799.785285:0:6585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784184799.785876:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784184799.785957:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184799.785961:0:6608:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784184799.785968:0:6608:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fc0d20000 00000020:00000080:3.0:1784184799.785971:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784184799.786012:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784184799.786015:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184799.786017:0:6608:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784184799.786026:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784184799.786168:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784184799.786187:0:6585:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784184799.786242:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.786253:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184799.786303:0:6585:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784184799.786306:0:6585:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b5fc0d20000 10000000:01000000:1.0:1784184799.786309:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b5fc0d20000 10000000:01000000:1.0:1784184799.786313:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784184799.786325:0:6585:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fc0d20000 from 1 10000000:01000000:1.0:1784184799.786328:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784184799.786406:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.786415:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.786424:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.786443:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431552:0@lo:101: 00000100:00100000:1.0:1784184799.786490:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.786521:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f86467480 going to sleep for 11 seconds 00000100:00100000:0.0:1784184799.786617:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431552 00000100:00100000:0.0:1784184799.786623:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431552 00000100:00100000:0.0:1784184799.786665:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784184799.786674:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265431552:12345-0@lo:101: 00010000:00010000:0.0:1784184799.786686:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184799.786698:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afdde expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.786821:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.786833:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.786841:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f80031200, rc 0) 00000100:00100000:0.0:1784184799.786892:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265431552:12345-0@lo:101: Request processed in 212us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184799.786899:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784184799.787046:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431552:0@lo:101: 00010000:00010000:1.0:1784184799.787060:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.787068:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184799.787167:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431680:0@lo:501: 00000100:00100000:1.0:1784184799.787196:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.787251:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f86467480 going to sleep for 11 seconds 00000100:00100000:2.0:1784184799.788418:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431680 00000100:00100000:2.0:1784184799.788427:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431680 00000100:00100000:2.0:1784184799.788582:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784184799.788591:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265431680:12345-0@lo:501: 00000100:00100000:2.0:1784184799.788880:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265431680:12345-0@lo:501: Request processed in 290us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184799.788898:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784184799.788971:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431680:0@lo:501: 00000100:00100000:1.0:1784184799.789011:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431808:0@lo:503: 00000100:00100000:1.0:1784184799.789052:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.789326:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f86467480 going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.789679:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431808 00000100:00100000:3.0:1784184799.789685:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431808 00000100:00100000:3.0:1784184799.789714:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784184799.790066:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265431808:12345-0@lo:503: 00000100:00100000:3.0:1784184799.790249:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265431808:12345-0@lo:503: Request processed in 187us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.790256:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784184799.790376:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431808:0@lo:503: 00000040:00080000:1.0:1784184799.790645:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784184799.790710:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431936:0@lo:502: 00000100:00100000:1.0:1784184799.790764:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.790793:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.790963:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265431936 00000100:00100000:3.0:1784184799.790968:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265431936 00000100:00100000:3.0:1784184799.790989:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784184799.790995:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265431936:12345-0@lo:502: 00000100:00100000:3.0:1784184799.791155:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265431936:12345-0@lo:502: Request processed in 160us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.791162:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784184799.791302:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265431936:0@lo:502: 00000040:00080000:1.0:1784184799.791588:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784184799.791648:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784184799.791686:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784184799.792018:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784184799.792062:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784184799.792113:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784184799.792150:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784184799.792185:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784184799.792240:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784184799.792290:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784184799.792326:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784184799.793044:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784184799.793083:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784184799.793117:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784184799.793187:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784184799.793227:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784184799.793263:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784184799.793401:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784184799.793443:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784184799.793475:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784184799.793527:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784184799.793564:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784184799.793598:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784184799.793647:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784184799.793693:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1784184799.794024:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784184799.794081:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784184799.794119:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1784184799.794164:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265432064:0@lo:502: 00000100:00100000:1.0:1784184799.794234:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.794322:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f86467480 going to sleep for 11 seconds 00000100:00100000:3.0:1784184799.794508:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432064 00000100:00100000:3.0:1784184799.794517:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432064 00000100:00100000:3.0:1784184799.794597:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784184799.794606:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265432064:12345-0@lo:502: 00000100:00100000:3.0:1784184799.794989:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265432064:12345-0@lo:502: Request processed in 384us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.794998:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784184799.795089:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265432064:0@lo:502: 00000040:00080000:1.0:1784184799.795166:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1784184799.795177:0:6585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1784184799.795825:0:6609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784184799.795842:0:6609:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b5fb74c19c0) 00000020:00000080:0.0:1784184799.795859:0:6609:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1784184799.796117:0:6609:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fc0d20000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784184799.796121:0:6609:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5fc0d20000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784184799.796124:0:6609:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fc0d20000 3 00010000:00080000:0.0:1784184799.796152:0:6609:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5fbf645800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1784184799.800309:0:6609:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1784184799.800960:0:6609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1784184799.801005:0:6609:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784184799.801017:0:6609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x63160f6fbe8afdf3 00000100:00080000:0.0:1784184799.801028:0:6609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784184799.801426:0:6609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b5fbf645800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1784184799.801466:0:6609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fb74a4e00 x1870853265432192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784184799.801538:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1870853265432192:0@lo:38: 00000100:00100000:3.0:1784184799.801609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184799.801703:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432192 00000100:00100000:2.0:1784184799.801712:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432192 00000100:00100000:2.0:1784184799.801755:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784184799.801763:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1870853265432192:12345-0@lo:38: 00010000:00080000:2.0:1784184799.801786:0:5793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1784184799.801815:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x63160f6fbe8afdfa 00000004:00100000:2.0:1784184799.801829:0:5793:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784184799.801857:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9b5faec54800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1784184799.801983:0:6609:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784184799.804732:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870853265432192:12345-0@lo:38: Request processed in 2949us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184799.804746:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1784184799.805593:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1784184799.805978:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1784184799.806002:0:6585:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784184799.806123:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184799.806135:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784184799.806179:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784184799.806182:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784184799.806183:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784184799.806184:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784184799.806185:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784184799.806187:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784184799.806188:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784184799.806189:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784184799.806191:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784184799.806192:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784184799.806194:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784184799.806197:0:6585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784184799.806199:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784184799.806200:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784184799.806202:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784184799.806207:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784184799.806208:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784184799.806209:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784184799.806210:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784184799.806211:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784184799.806212:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784184799.806212:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784184799.806213:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784184799.806238:0:6585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784184799.806254:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265432320:0@lo:253: 00000100:00100000:1.0:1784184799.806354:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.806386:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83f05cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184799.806901:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432320 00000100:00100000:2.0:1784184799.806909:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432320 00000100:00100000:2.0:1784184799.806951:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784184799.806959:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6585:x1870853265432320:12345-0@lo:253: 20000000:01000000:2.0:1784184799.806985:0:5786:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784184799.806997:0:5786:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1784184799.807864:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b5fb74a4e00 x1870853265432192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784184809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184799.807876:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784184799.807950:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1784184799.807958:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784184799.807964:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784184799.807967:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fbf645800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784184799.807976:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1870853265432192:0@lo:38: 20000000:01000000:1.0:1784184799.843447:0:5786:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784184799.843465:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784184799.843606:0:5808:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784184799.843612:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784184799.843632:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.843651:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8afd6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.843671:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.843708:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8afd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.843789:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8afd6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 12 pid: 5787 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.843805:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1870853265432448:0@lo:104: 00000100:00100000:2.0:1784184799.843866:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184799.843977:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432448 00000100:00100000:1.0:1784184799.843985:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432448 00000100:00100000:3.0:1784184799.844208:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784184799.844220:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5808:x1870853265432448:12345-0@lo:104: 00010000:00010000:3.0:1784184799.844233:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.844361:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f90287780 going to sleep for 11 seconds 00010000:00010000:3.0:1784184799.846652:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784184799.846666:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5808:x1870853265432448:12345-0@lo:104: Request processed in 2446us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184799.846678:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784184799.846832:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1870853265432448:0@lo:104: 00010000:00010000:2.0:1784184799.846856:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.846974:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784184799.846981:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.846990:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f200 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784184799.846994:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.847004:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184799.847011:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184799.847017:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784184799.847075:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.847082:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784184799.847147:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265432576:0@lo:103: 00000100:00100000:2.0:1784184799.847190:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784184799.847487:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.847512:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f200/0x63160f6fbe8afd67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afd6e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184799.847529:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184799.847531:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184799.847532:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184799.847837:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432576 00000100:00100000:2.0:1784184799.847845:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432576 00010000:00010000:2.0:1784184799.847870:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8afd6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 13 pid: 5787 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184799.847914:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784184799.847923:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3313:x1870853265432576:12345-0@lo:103: 00010000:00010000:2.0:1784184799.847937:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184799.847941:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8afd6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 13 pid: 5787 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.847958:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8afd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 13 pid: 5787 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.847971:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8afd6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afd67 expref: 13 pid: 5787 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.847985:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.847993:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784184799.848008:0:5779:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004396850s 00010000:00010000:2.0:1784184799.848012:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848018:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848023:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848030:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848048:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971e00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784184799.848052:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848060:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848079:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848088:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184799.848328:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3313:x1870853265432576:12345-0@lo:103: Request processed in 406us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184799.848363:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1784184799.848413:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848421:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184799.848427:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8afe01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184799.848510:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265432576:0@lo:103: 00000100:00100000:2.0:1784184799.858423:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:6585:x1870853265432320:12345-0@lo:253: Request processed in 51456us (52085us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184799.858440:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784184799.858564:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6585:1870853265432320:0@lo:253: 10000000:01000000:1.0:1784184799.858578:0:6585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784184799.858581:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784184799.858583:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784184799.858585:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784184799.858586:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784184799.858587:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784184799.858588:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784184799.858590:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784184799.858592:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784184799.858593:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784184799.858594:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784184799.858596:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784184799.858611:0:6585:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1784184799.865481:0:6585:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1784184799.865686:0:6585:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784184799.866192:0:6585:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1784184799.866510:0:6585:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784184799.866808:0:6585:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1784184799.867504:0:6585:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1784184799.869425:0:6585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1784184800.118495:0:6585:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784184800.118503:0:6585:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784184800.118534:0:6585:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784184800.118594:0:6585:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784184800.118609:0:6585:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784184800.118635:0:6585:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1784184800.778480:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184801.804160:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784184801.941047:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784184801.941054:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5f85958000 from 21 10000000:01000000:0.0:1784184801.941060:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784184801.941102:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.941114:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.941124:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184801.941147:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265432704:0@lo:101: 00000100:00100000:0.0:1784184801.941214:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.941290:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184801.946084:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432704 00000100:00100000:3.0:1784184801.946099:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432704 00000100:00100000:3.0:1784184801.946154:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784184801.946164:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:5789:x1870853265432704:12345-0@lo:101: 00010000:00010000:3.0:1784184801.946180:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184801.946198:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afe08 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184801.946225:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184801.946247:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184801.946265:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a200, rc 0) 00000100:00100000:3.0:1784184801.946350:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265432704:12345-0@lo:101: Request processed in 188us (5136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184801.946357:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784184801.946804:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265432704:0@lo:101: 00010000:00010000:0.0:1784184801.946823:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.946834:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184801.947806:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265432832:0@lo:501: 00000100:00100000:0.0:1784184801.947858:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.948218:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184801.948327:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432832 00000100:00100000:3.0:1784184801.948344:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432832 00000100:00100000:3.0:1784184801.948387:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784184801.948395:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265432832:12345-0@lo:501: 00000100:00100000:3.0:1784184801.948751:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265432832:12345-0@lo:501: Request processed in 356us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184801.948758:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784184801.950146:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265432832:0@lo:501: 00000100:00100000:0.0:1784184801.950203:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265432960:0@lo:503: 00000100:00100000:0.0:1784184801.950274:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.950304:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.950322:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265432960 00000100:00100000:0.0:1784184801.950327:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265432960 00000100:00100000:0.0:1784184801.950381:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784184801.950388:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265432960:12345-0@lo:503: 00000100:00100000:0.0:1784184801.958841:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265432960:12345-0@lo:503: Request processed in 8445us (8559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.958856:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784184801.968675:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265432960:0@lo:503: 00000100:00100000:3.0:1784184801.975259:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6699:1870853265433088:0@lo:502: 00000100:00100000:3.0:1784184801.975365:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184801.975418:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbf877900 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.978051:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433088 00000100:00100000:0.0:1784184801.978062:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433088 00000100:00100000:0.0:1784184801.978113:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784184801.978121:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6699:x1870853265433088:12345-0@lo:502: 00000100:00100000:0.0:1784184801.978478:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6699:x1870853265433088:12345-0@lo:502: Request processed in 356us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.978504:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784184801.978568:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6699:1870853265433088:0@lo:502: 00000100:00100000:0.0:1784184801.978632:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6699:1870853265433216:0@lo:502: 00000100:00100000:0.0:1784184801.978674:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184801.982161:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433216 00000100:00100000:2.0:1784184801.982175:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433216 00000100:00100000:2.0:1784184801.982243:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784184801.982253:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6699:x1870853265433216:12345-0@lo:502: 00000100:00100000:2.0:1784184801.982532:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:6699:x1870853265433216:12345-0@lo:502: Request processed in 280us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184801.982541:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784184801.983290:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.983318:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6699:1870853265433216:0@lo:502: 00000040:00080000:0.0:1784184801.983365:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784184801.983429:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784184801.983447:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784184801.983456:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.983467:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184801.983476:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784184801.983479:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5f85958000 from 4 10000000:01000000:0.0:1784184801.983481:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784184801.983511:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.983520:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.983529:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184801.983547:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433344:0@lo:101: 00000100:00100000:0.0:1784184801.983594:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.983617:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.983629:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433344 00000100:00100000:0.0:1784184801.983634:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433344 00000100:00100000:0.0:1784184801.983662:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784184801.983670:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265433344:12345-0@lo:101: 00010000:00010000:0.0:1784184801.983679:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184801.983779:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afe16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.983803:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.983814:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.983823:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631cc00, rc 0) 00000100:00100000:0.0:1784184801.983986:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265433344:12345-0@lo:101: Request processed in 196us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.983993:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784184801.984031:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433344:0@lo:101: 00010000:00010000:0.0:1784184801.984043:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984051:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184801.984093:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433472:0@lo:256: 00000100:00100000:0.0:1784184801.984132:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.984145:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.984156:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433472 00000100:00100000:0.0:1784184801.984159:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433472 00000100:00100000:0.0:1784184801.984182:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784184801.984189:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265433472:12345-0@lo:256: 20000000:01000000:0.0:1784184801.984203:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784184801.984218:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784184801.984221:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1784184801.984309:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265433472:12345-0@lo:256: Request processed in 120us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.984316:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784184801.984365:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433472:0@lo:256: 10000000:01000000:0.0:1784184801.984402:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784184801.984407:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984414:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184801.984421:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784184801.984423:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1784184801.984426:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784184801.984441:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984447:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984464:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184801.984475:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433600:0@lo:101: 00000100:00100000:0.0:1784184801.984498:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.984511:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.984523:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433600 00000100:00100000:0.0:1784184801.984526:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433600 00000100:00100000:0.0:1784184801.984546:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784184801.984552:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265433600:12345-0@lo:101: 00010000:00010000:0.0:1784184801.984559:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184801.984567:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afe24 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984580:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984588:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984594:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d600, rc 0) 00000100:00100000:0.0:1784184801.984620:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265433600:12345-0@lo:101: Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.984626:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784184801.984652:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433600:0@lo:101: 00010000:00010000:0.0:1784184801.984662:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184801.984678:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184801.984719:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433728:0@lo:501: 00000100:00100000:0.0:1784184801.984743:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.984755:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.984765:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433728 00000100:00100000:0.0:1784184801.984768:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433728 00000100:00100000:0.0:1784184801.984783:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784184801.984789:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265433728:12345-0@lo:501: 00000100:00100000:0.0:1784184801.985036:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265433728:12345-0@lo:501: Request processed in 247us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.985043:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784184801.985069:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433728:0@lo:501: 00000100:00100000:0.0:1784184801.985093:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433856:0@lo:503: 00000100:00100000:0.0:1784184801.985128:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184801.985141:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fe0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.985151:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433856 00000100:00100000:0.0:1784184801.985154:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433856 00000100:00100000:0.0:1784184801.985170:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784184801.985175:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265433856:12345-0@lo:503: 00000100:00100000:0.0:1784184801.985492:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265433856:12345-0@lo:503: Request processed in 315us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.985498:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784184801.985536:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265433856:0@lo:503: 00000100:00100000:1.0:1784184801.990524:0:6701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6701:1870853265433984:0@lo:502: 00000100:00100000:1.0:1784184801.990610:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184801.990652:0:6701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83f05600 going to sleep for 11 seconds 00000100:00100000:0.0:1784184801.990785:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265433984 00000100:00100000:0.0:1784184801.990793:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265433984 00000100:00100000:0.0:1784184801.990842:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784184801.990859:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:6701:x1870853265433984:12345-0@lo:502: 00000100:00100000:0.0:1784184801.991163:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:6701:x1870853265433984:12345-0@lo:502: Request processed in 312us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184801.991172:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784184801.995791:0:6701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6701:1870853265433984:0@lo:502: 00000020:01000000:2.0:1784184801.995852:0:6701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784184801.995859:0:6701:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784184801.995879:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184801.995882:0:6701:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784184801.995886:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784184801.995890:0:6701:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:2.0:1784184801.995911:0:6701:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784184801.995914:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784184801.995929:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b5f844f99c0) 00000020:00000080:2.0:1784184801.995949:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1784184801.995953:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784184801.996026:0:6701:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784184801.996031:0:6701:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784184801.996038:0:6701:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8afe39 00010000:00080000:2.0:1784184801.996064:0:6701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5f844a8000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1784184801.996299:0:6701:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1784184802.113292:0:6701:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784184802.113314:0:6701:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784184802.114669:0:6701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784184802.115034:0:6701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784184802.115089:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1784184802.115216:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784184802.128408:0:6712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784184802.128416:0:6712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784184802.130752:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784184802.130767:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784184802.130803:0:6701:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784184802.130826:0:6701:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8afe40 00000100:00080000:3.0:1784184802.130836:0:6701:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784184802.130842:0:6701:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b5f844a8000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1784184802.130890:0:6701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fb89c2300 x1870853265434112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784184802.130917:0:6701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784184802.130979:0:6701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784184802.130993:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184802.130995:0:6701:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784184802.130999:0:6701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784184802.131003:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184802.131004:0:6701:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784184802.131007:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784184802.131009:0:6701:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784184802.131034:0:6701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6701:1870853265434240:0@lo:502: 00000100:00100000:0.0:1784184802.131461:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265434368:0@lo:400: 00000100:00100000:0.0:1784184802.131501:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.131574:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265434496:0@lo:400: 00000100:00100000:0.0:1784184802.131603:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.131649:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265434368 00000100:00100000:0.0:1784184802.131655:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265434368 00000100:00100000:0.0:1784184802.131690:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265434496 00000100:00100000:0.0:1784184802.131693:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265434496 00000100:00100000:0.0:1784184802.131732:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784184802.131740:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265434368:12345-0@lo:400: 00000100:00100000:0.0:1784184802.131789:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265434368:12345-0@lo:400: Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184802.131796:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784184802.131811:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784184802.131817:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265434496:12345-0@lo:400: 00000100:00100000:0.0:1784184802.132030:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265434496:12345-0@lo:400: Request processed in 212us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184802.132038:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1784184802.132062:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784184802.132112:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb74a5180 x1870853265434496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184802.132125:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265434496:0@lo:400: 00010000:00080000:0.0:1784184802.132156:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb74a7480 x1870853265434368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184802.132164:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265434368:0@lo:400: 00000100:00100000:3.0:1784184802.132448:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184802.132475:0:6701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5000 going to sleep for 11 seconds 00000100:00100000:1.0:1784184802.132824:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265434112:0@lo:8: 00000100:00100000:1.0:1784184802.132884:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.133772:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265434240 00000100:00100000:0.0:1784184802.133781:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265434240 00000100:00100000:0.0:1784184802.133821:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784184802.133829:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:6701:x1870853265434240:12345-0@lo:502: 00000100:00100000:0.0:1784184802.134279:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:6701:x1870853265434240:12345-0@lo:502: Request processed in 450us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184802.134288:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784184802.134523:0:6701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6701:1870853265434240:0@lo:502: 00000020:01000000:3.0:1784184802.134702:0:6701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784184802.134796:0:6701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184802.134799:0:6701:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784184802.134805:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1784184802.135312:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1784184802.135443:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784184802.135455:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.135466:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184802.135476:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784184802.135478:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5f85958000 from 1 10000000:01000000:0.0:1784184802.135481:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784184802.135512:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.135520:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.135539:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184802.136034:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265434112 00000100:00100000:2.0:1784184802.136042:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265434112 00000100:00100000:2.0:1784184802.136188:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784184802.136196:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1870853265434112:12345-0@lo:8: 00010000:00080000:2.0:1784184802.136221:0:6588:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1784184802.136258:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8afe4e 00002000:00100000:2.0:1784184802.136298:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b5f844ad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784184802.136312:0:6588:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1784184802.136316:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784184802.136473:0:6588:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784184802.136646:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784184802.136671:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d92800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784184802.136763:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1870853265434112:12345-0@lo:8: Request processed in 566us (3877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184802.136770:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784184802.138347:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265434624:0@lo:101: 00000100:00100000:0.0:1784184802.138411:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.138455:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f7540 going to sleep for 11 seconds 00000100:00100000:1.0:1784184802.138583:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265434624 00000100:00100000:1.0:1784184802.138592:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265434624 00000100:00100000:1.0:1784184802.138643:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784184802.138653:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265434624:12345-0@lo:101: 00010000:00010000:1.0:1784184802.138667:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184802.138685:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afe47 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184802.138717:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184802.138727:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184802.138735:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f200, rc 0) 00000100:00100000:1.0:1784184802.138773:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265434624:12345-0@lo:101: Request processed in 122us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184802.138779:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784184802.139180:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265434624:0@lo:101: 00010000:00010000:0.0:1784184802.139195:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.139203:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184802.139268:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265434752:0@lo:501: 00000100:00100000:0.0:1784184802.139294:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.139318:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1784184802.139354:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265434752 00000100:00100000:0.0:1784184802.139358:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265434752 00000100:00100000:0.0:1784184802.139383:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784184802.139390:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265434752:12345-0@lo:501: 00000100:00100000:0.0:1784184802.139634:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265434752:12345-0@lo:501: Request processed in 243us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184802.139641:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784184802.139673:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265434752:0@lo:501: 00000100:00100000:0.0:1784184802.139698:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265434880:0@lo:503: 00000100:00100000:0.0:1784184802.139751:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.139766:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1784184802.139777:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265434880 00000100:00100000:0.0:1784184802.139780:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265434880 00000100:00100000:0.0:1784184802.139801:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784184802.139807:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265434880:12345-0@lo:503: 00000100:00100000:0.0:1784184802.140920:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265434880:12345-0@lo:503: Request processed in 1039us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184802.140930:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784184802.140983:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265434880:0@lo:503: 00010000:00080000:2.0:1784184802.147392:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb89c2300 x1870853265434112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784184812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184802.147405:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784184802.147415:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784184802.147424:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784184802.147430:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784184802.147434:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5f844a8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784184802.147455:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784184802.147462:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265434112:0@lo:8: 00000004:00080000:3.0:1784184802.147588:0:6712:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784184802.147735:0:6712:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200313402054ns, next at 0ns, rc = 0 00000100:00100000:1.0:1784184802.148082:0:6714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6714:1870853265435008:0@lo:502: 00000100:00100000:1.0:1784184802.148155:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184802.148318:0:6714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83f05480 going to sleep for 11 seconds 00000100:00100000:2.0:1784184802.160301:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435008 00000100:00100000:2.0:1784184802.160316:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435008 00000100:00100000:2.0:1784184802.160630:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784184802.160640:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:6714:x1870853265435008:12345-0@lo:502: 00000100:00100000:2.0:1784184802.160899:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:6714:x1870853265435008:12345-0@lo:502: Request processed in 260us (12743us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184802.160907:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784184802.160959:0:6714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6714:1870853265435008:0@lo:502: 00000020:01000000:2.0:1784184802.160992:0:6714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784184802.161007:0:6714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184802.161009:0:6714:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784184802.161017:0:6714:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5f85958000 00000020:00000080:2.0:1784184802.161019:0:6714:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784184802.161055:0:6714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6714:1870853265435136:0@lo:502: 00000100:00100000:2.0:1784184802.161100:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184802.161132:0:6714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f82ad6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784184802.161147:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435136 00000100:00100000:2.0:1784184802.161152:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435136 00000100:00100000:2.0:1784184802.161167:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784184802.161173:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:6714:x1870853265435136:12345-0@lo:502: 00000100:00100000:2.0:1784184802.161297:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:6714:x1870853265435136:12345-0@lo:502: Request processed in 123us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184802.161304:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784184802.161361:0:6714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:6714:1870853265435136:0@lo:502: 00000020:01000000:2.0:1784184802.161379:0:6714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184802.161383:0:6714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184802.161385:0:6714:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784184802.161388:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784184802.162276:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784184802.162298:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784184802.162309:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.162321:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184802.162358:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784184802.162361:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b5f90580000 from 1 10000000:01000000:0.0:1784184802.162363:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784184802.162390:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.162398:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.162408:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184802.162439:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265435264:0@lo:101: 00000100:00100000:0.0:1784184802.162477:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.162506:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f7540 going to sleep for 11 seconds 00000100:00100000:1.0:1784184802.165593:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435264 00000100:00100000:1.0:1784184802.165613:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435264 00000100:00100000:1.0:1784184802.165664:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784184802.165673:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265435264:12345-0@lo:101: 00010000:00010000:1.0:1784184802.165687:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184802.165715:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afe5c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184802.165740:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184802.165751:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184802.165759:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e600, rc 0) 00000100:00100000:1.0:1784184802.165837:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265435264:12345-0@lo:101: Request processed in 165us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184802.165855:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784184802.166154:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265435264:0@lo:101: 00010000:00010000:0.0:1784184802.166172:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.166181:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184802.166254:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265435392:0@lo:501: 00000100:00100000:0.0:1784184802.166288:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.166322:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f7540 going to sleep for 11 seconds 00000100:00100000:1.0:1784184802.174404:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435392 00000100:00100000:1.0:1784184802.174418:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435392 00000100:00100000:1.0:1784184802.174471:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784184802.174481:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265435392:12345-0@lo:501: 00000100:00100000:1.0:1784184802.174764:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265435392:12345-0@lo:501: Request processed in 284us (8474us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784184802.174772:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784184802.175563:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265435392:0@lo:501: 10000000:01000000:0.0:1784184802.175602:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784184802.175613:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184802.175624:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784184802.267723:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784184802.381257:0:6713:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784184802.381292:0:6713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265435648:0@lo:7: 00000100:00100000:0.0:1784184802.381395:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.381451:0:6713:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7d7c780 going to sleep for 11 seconds 00000100:00100000:0.0:1784184802.381465:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184802.381476:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265435520:0@lo:13: 00000100:00100000:0.0:1784184802.381501:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.381542:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435648 00000100:00100000:0.0:1784184802.381548:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435648 00000100:00100000:0.0:1784184802.381591:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784184802.381600:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6713:x1870853265435648:12345-0@lo:7: 00000100:00100000:1.0:1784184802.381975:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435520 00000100:00100000:1.0:1784184802.381980:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435520 00000100:00100000:1.0:1784184802.382007:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784184802.382014:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1870853265435520:12345-0@lo:13: 00002000:00000024:1.0:1784184802.382037:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784184802.382092:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1870853265435520:12345-0@lo:13: Request processed in 78us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184802.382100:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1784184802.397383:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1784184802.397390:0:6590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784184802.397489:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6713:x1870853265435648:12345-0@lo:7: Request processed in 15886us (16090us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184802.397499:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784184802.397542:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184802.397587:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb74a7480 x1870853265435520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184802.397610:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265435520:0@lo:13: 00010000:00080000:1.0:1784184802.398456:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb74a5180 x1870853265435648/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784184818 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184802.398469:0:6713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265435648:0@lo:7: 00000004:00080000:1.0:1784184802.398480:0:6713:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1784184802.398518:0:6713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265435776:0@lo:5: 00000100:00100000:1.0:1784184802.398559:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184802.398597:0:6713:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f90287e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184802.398617:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435776 00000100:00100000:1.0:1784184802.398622:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435776 00000100:00100000:1.0:1784184802.398664:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784184802.398673:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6713:x1870853265435776:12345-0@lo:5: 00002000:00080000:1.0:1784184802.398697:0:6588:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784184802.398701:0:6588:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784184802.398978:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6713:x1870853265435776:12345-0@lo:5: Request processed in 304us (416us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784184802.398984:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784184802.399018:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5f982c2a00 x1870853265435776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784184818 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184802.399028:0:6713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265435776:0@lo:5: 00000004:00080000:1.0:1784184802.399036:0:6713:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784184802.399058:0:6713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265435904:0@lo:700: 00000100:00100000:1.0:1784184802.399081:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184802.399094:0:6713:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f90287e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784184802.405596:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265435904 00000100:00100000:0.0:1784184802.405611:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265435904 00000100:00100000:0.0:1784184802.405671:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784184802.405682:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6713:x1870853265435904:12345-0@lo:700: 00000100:00100000:0.0:1784184802.405749:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6597:1870853265436032:0@lo:700: 00000100:00100000:0.0:1784184802.405806:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184802.405835:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7d7c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784184802.412768:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436032 00000100:00100000:0.0:1784184802.412781:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436032 00000100:00100000:0.0:1784184802.412832:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784184802.412850:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6597:x1870853265436032:12345-0@lo:700: 40000000:02000000:0.0:1784184802.472632:0:5799:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1784184802.486766:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6597:x1870853265436032:12345-0@lo:700: Request processed in 73916us (80949us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184802.486787:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784184802.488886:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb74a7480 x1870853265436032/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784184818 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184802.488905:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6597:1870853265436032:0@lo:700: 40000000:02000000:0.0:1784184802.488920:0:6597:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1784184802.617625:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6713:x1870853265435904:12345-0@lo:700: Request processed in 211935us (218532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184802.617658:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1784184802.618673:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1784184802.618692:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1784184802.620684:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5f982c0000 x1870853265435904/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784184818 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184802.620705:0:6713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265435904:0@lo:700: 00000004:02000040:2.0:1784184802.667306:0:6713:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1784184802.672995:0:6713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265436160:0@lo:5: 00000100:00100000:3.0:1784184802.673072:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184802.673171:0:6713:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184802.673254:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436160 00000100:00100000:0.0:1784184802.673262:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436160 00000100:00100000:0.0:1784184802.673866:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784184802.673878:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6713:x1870853265436160:12345-0@lo:5: 00002000:00080000:1.0:1784184802.685970:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1784184802.685994:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1784184802.695081:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6713:x1870853265436160:12345-0@lo:5: Request processed in 21197us (22000us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784184802.695096:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784184802.710825:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb89c0a80 x1870853265436160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784184818 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184802.710854:0:6713:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784184802.710873:0:6713:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b5fb89c0a80 x1870853265436160/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784184818 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184802.710884:0:6713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6713:1870853265436160:0@lo:5: 00000004:00080000:0.0:1784184802.710897:0:6713:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1784184802.826967:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184803.850534:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184804.879140:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184805.901996:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184806.926948:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784184807.571812:0:6958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784184807.626824:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265436288:0@lo:13: 00000100:00100000:3.0:1784184807.626902:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184807.626980:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436288 00000100:00100000:3.0:1784184807.626988:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436288 00000100:00100000:3.0:1784184807.627039:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784184807.627047:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265436288:12345-0@lo:13: 00002000:00000024:3.0:1784184807.627081:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184807.627132:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265436288:12345-0@lo:13: Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184807.627158:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784184807.627179:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784184807.627207:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb89c0e00 x1870853265436288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184807.627224:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265436288:0@lo:13: 00000100:00100000:1.0:1784184807.642832:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265436416:0@lo:400: 00000100:00100000:1.0:1784184807.642912:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184807.642987:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265436544:0@lo:400: 00000100:00100000:1.0:1784184807.643014:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184807.643039:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784184807.643045:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265436672:0@lo:400: 00000100:00100000:1.0:1784184807.643071:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184807.651441:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436544 00000100:00100000:0.0:1784184807.655581:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436544 00000100:00100000:0.0:1784184807.656909:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436672 00000100:00100000:0.0:1784184807.656926:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436672 00000100:00100000:0.0:1784184807.656961:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784184807.656971:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265436544:12345-0@lo:400: 00000100:00100000:0.0:1784184807.657064:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265436544:12345-0@lo:400: Request processed in 93us (14048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184807.657070:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784184807.657087:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784184807.657093:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265436672:12345-0@lo:400: 00000100:00100000:0.0:1784184807.657119:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265436672:12345-0@lo:400: Request processed in 27us (14048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184807.657125:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784184807.658509:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436416 00000100:00100000:2.0:1784184807.658520:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436416 00000100:00100000:2.0:1784184807.658561:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784184807.658569:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3314:x1870853265436416:12345-0@lo:400: 00000100:00100000:2.0:1784184807.658642:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3314:x1870853265436416:12345-0@lo:400: Request processed in 73us (15729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184807.658650:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1784184807.662917:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5f982c1880 x1870853265436672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184807.662934:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265436672:0@lo:400: 00010000:00080000:1.0:1784184807.662947:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5f982c3480 x1870853265436544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184807.662956:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265436544:0@lo:400: 00000100:00100000:1.0:1784184807.663000:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265436416:0@lo:400: 00000100:00080000:0.0:1784184807.664209:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1784184807.730163:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1784184807.948315:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184808.978476:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184809.995259:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184811.027402:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184812.044155:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184812.746930:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265436800:0@lo:13: 00000100:00100000:3.0:1784184812.746997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184812.747074:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436800 00000100:00100000:3.0:1784184812.747081:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436800 00000100:00100000:3.0:1784184812.747134:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784184812.747142:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265436800:12345-0@lo:13: 00002000:00000024:3.0:1784184812.747174:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184812.747215:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265436800:12345-0@lo:13: Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184812.747235:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784184812.747253:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784184812.747280:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb89c0e00 x1870853265436800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184812.747291:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784184812.747308:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265436800:0@lo:13: 00000100:00100000:3.0:1784184812.748313:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265437184:0@lo:400: 00000100:00100000:1.0:1784184812.748485:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265437056:0@lo:400: 00000100:00100000:2.0:1784184812.752606:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784184812.752633:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265436928:0@lo:400: 00000100:00100000:1.0:1784184812.754827:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184812.755091:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437056 00000100:00100000:0.0:1784184812.755101:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437056 00000100:00100000:0.0:1784184812.755162:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784184812.755171:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265437056:12345-0@lo:400: 00000100:00100000:0.0:1784184812.755243:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265437056:12345-0@lo:400: Request processed in 74us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184812.755251:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1784184812.755639:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb89c0a80 x1870853265437056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184812.755672:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265437056:0@lo:400: 00000100:00100000:3.0:1784184812.758282:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184812.760576:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437184 00000100:00100000:1.0:1784184812.760595:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437184 00000100:00100000:1.0:1784184812.760687:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784184812.760698:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265437184:12345-0@lo:400: 00000100:00100000:1.0:1784184812.760800:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265437184:12345-0@lo:400: Request processed in 105us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184812.760808:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784184812.760859:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb89c3480 x1870853265437184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184812.760874:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265437184:0@lo:400: 00000100:00080000:3.0:1784184812.761000:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184812.761026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184812.761217:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265436928 00000100:00100000:3.0:1784184812.761233:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265436928 00000100:00100000:3.0:1784184812.761274:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784184812.761281:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3313:x1870853265436928:12345-0@lo:400: 00000100:00100000:3.0:1784184812.761359:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3313:x1870853265436928:12345-0@lo:400: Request processed in 79us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184812.761365:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784184812.761590:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265436928:0@lo:400: 00010000:00010000:3.0:1784184813.071861:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184814.098915:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184815.116919:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184816.145079:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184817.163191:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184817.868937:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265437312:0@lo:13: 00000100:00100000:1.0:1784184817.869016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184817.869299:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437312 00000100:00100000:3.0:1784184817.869307:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437312 00000100:00100000:3.0:1784184817.869391:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784184817.869401:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265437312:12345-0@lo:13: 00002000:00000024:3.0:1784184817.869434:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184817.869475:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265437312:12345-0@lo:13: Request processed in 76us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184817.869483:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784184817.869886:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265437568:0@lo:400: 00000100:00100000:0.0:1784184817.869922:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184817.869945:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184817.869951:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265437696:0@lo:400: 00000100:00100000:0.0:1784184817.869998:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184817.870029:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437568 00000100:00100000:0.0:1784184817.870033:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437568 00000100:00100000:0.0:1784184817.870058:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437696 00000100:00100000:0.0:1784184817.870061:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437696 00000100:00100000:0.0:1784184817.870076:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784184817.870082:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265437568:12345-0@lo:400: 00000100:00100000:0.0:1784184817.870117:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265437568:12345-0@lo:400: Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184817.870123:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784184817.870134:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784184817.870139:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265437696:12345-0@lo:400: 00000100:00100000:0.0:1784184817.870164:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265437696:12345-0@lo:400: Request processed in 24us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184817.870169:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784184817.870190:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265437440:0@lo:400: 00000100:00100000:0.0:1784184817.870216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184817.870250:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437440 00000100:00100000:0.0:1784184817.870253:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437440 00000100:00100000:0.0:1784184817.870277:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784184817.870283:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3314:x1870853265437440:12345-0@lo:400: 00000100:00100000:0.0:1784184817.870314:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3314:x1870853265437440:12345-0@lo:400: Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184817.870320:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784184817.870378:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265437440:0@lo:400: 00010000:00080000:0.0:1784184817.870404:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb74a6d80 x1870853265437696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184817.870421:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265437696:0@lo:400: 00010000:00080000:0.0:1784184817.870434:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb74a4380 x1870853265437568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184817.870442:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265437568:0@lo:400: 00000100:00080000:1.0:1784184817.870932:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784184817.870937:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784184817.870964:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fc13b5880 x1870853265437312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184817.870995:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265437312:0@lo:13: 00010000:00010000:0.0:1784184818.188068:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184819.210752:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784184820.058903:0:7485:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784184820.058908:0:7485:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1784184820.059034:0:7485:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b5fbfbf1800 00000020:01000004:2.0:1784184820.059124:0:7485:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784184820.059138:0:7485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1784184820.059151:0:7485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b5f844fb380) 00000020:00000080:2.0:1784184820.059168:0:7485:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784184820.077130:0:7485:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784184820.077659:0:7485:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784184820.100620:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784184820.106012:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784184820.106122:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784184820.106185:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784184820.106212:0:7485:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784184820.106729:0:7485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784184820.106738:0:7485:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784184820.106844:0:7485:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63160f6fbe8afe71 00000020:01000004:2.0:1784184820.106852:0:7485:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784184820.106869:0:7485:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784184820.106871:0:7485:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784184820.106876:0:7485:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784184820.106894:0:7485:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784184820.106897:0:7485:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1784184820.144649:0:7485:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784184820.144688:0:7485:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1784184820.144692:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784184820.144694:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784184820.144695:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784184820.144697:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784184820.144698:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784184820.144699:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784184820.144701:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784184820.144702:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784184820.144704:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784184820.144705:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784184820.144707:0:7485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784184820.144710:0:7485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1784184820.144712:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784184820.144714:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784184820.144715:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784184820.144716:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784184820.144717:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784184820.144718:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784184820.144719:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784184820.144720:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784184820.144721:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784184820.144722:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784184820.144723:0:7485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784184820.144754:0:7485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784184820.144772:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265437824:0@lo:253: 00000100:00100000:0.0:1784184820.144842:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184820.144904:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc1834780 going to sleep for 11 seconds 00000100:00100000:2.0:1784184820.144929:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437824 00000100:00100000:2.0:1784184820.144946:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437824 00000100:00100000:2.0:1784184820.144999:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784184820.145009:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:7485:x1870853265437824:12345-0@lo:253: 20000000:01000000:2.0:1784184820.145039:0:5786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784184820.145044:0:5786:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1784184820.145049:0:5786:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1784184820.145052:0:5786:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1784184820.146042:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784184820.146236:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1784184820.146248:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1784184820.146279:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1784184820.146286:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1784184820.146309:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1784184820.146379:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1784184820.146704:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1784184820.146721:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:2.0:1784184820.146724:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:2.0:1784184820.146757:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1784184820.146765:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784184820.146812:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1784184820.146819:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:2.0:1784184820.146855:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1784184820.146864:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784184820.146918:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1784184820.147002:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1784184820.147752:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1784184820.147770:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:2.0:1784184820.147772:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:2.0:1784184820.147807:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1784184820.147815:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784184820.147846:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1784184820.147858:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:2.0:1784184820.147894:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1784184820.147903:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784184820.155804:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1784184820.155911:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1784184820.155952:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784184820.155956:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784184820.155961:0:5786:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784184820.155974:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784184820.155977:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784184820.156023:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784184820.156026:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784184820.163741:0:7487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784184820.163835:0:7487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784184820.163887:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1784184820.164238:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1784184820.164278:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1784184820.164371:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1784184820.164386:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784184820.164389:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784184820.164851:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1784184820.165526:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1784184820.165596:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1784184820.165655:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1784184820.165682:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784184820.165685:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784184820.167030:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1784184820.167116:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1784184820.167178:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1784184820.171413:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1784184820.171463:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1784184820.171530:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1784184820.171544:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784184820.171557:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784184820.174012:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1784184820.174100:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1784184820.174153:0:7490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1784184820.174614:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1784184820.174657:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1784184820.174703:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1784184820.174720:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1784184820.174723:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1784184820.174732:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784184820.174928:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.174956:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f80031a00/0x63160f6fbe8afdbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.174964:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.174969:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.174975:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.174981:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.174987:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.175035:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.175049:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 16 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.175063:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265437952:0@lo:104: 00000100:00100000:1.0:1784184820.175124:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784184820.175174:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.175182:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 16 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.175189:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438080:0@lo:104: 00010000:00010000:1.0:1784184820.175211:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.175219:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 16 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.175226:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438208:0@lo:104: 00010000:00010000:1.0:1784184820.175246:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.175254:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 16 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.175260:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438336:0@lo:104: 00010000:00010000:1.0:1784184820.175292:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f80031a00/0x63160f6fbe8afdbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.175299:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f80031a00/0x63160f6fbe8afdbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 16 pid: 5784 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.175307:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438464:0@lo:104: 00000100:00100000:1.0:1784184820.175322:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87c9f180 going to sleep for 11 seconds 00000100:00100000:2.0:1784184820.178427:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784184820.178472:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.178511:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.178522:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.178531:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.178544:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265437952 00000100:00100000:2.0:1784184820.178552:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265437952 00000100:00100000:2.0:1784184820.178589:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438080 00000100:00100000:2.0:1784184820.178592:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438080 00000100:00100000:2.0:1784184820.178600:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438208 00000100:00100000:2.0:1784184820.178602:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438208 00000100:00100000:2.0:1784184820.178609:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438336 00000100:00100000:2.0:1784184820.178624:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438336 00000100:00100000:2.0:1784184820.178636:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438464 00000100:00100000:2.0:1784184820.178638:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438464 00000100:00100000:2.0:1784184820.178650:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784184820.178658:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f90264050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+7:5786:x1870853265437952:12345-0@lo:104: 00010000:00010000:2.0:1784184820.178674:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.178761:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784184820.178768:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f90264050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+7:5786:x1870853265437952:12345-0@lo:104: Request processed in 111us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.178774:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784184820.178812:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784184820.178817:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:5786:x1870853265438080:12345-0@lo:104: 00010000:00010000:2.0:1784184820.178824:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.178856:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784184820.178861:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:5786:x1870853265438080:12345-0@lo:104: Request processed in 45us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.178867:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784184820.178879:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784184820.178885:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:5786:x1870853265438208:12345-0@lo:104: 00010000:00010000:2.0:1784184820.178892:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.178917:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784184820.178922:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:5786:x1870853265438208:12345-0@lo:104: Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.178947:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784184820.178960:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784184820.178966:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:5786:x1870853265438336:12345-0@lo:104: 00010000:00010000:2.0:1784184820.178973:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.179001:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784184820.179007:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:5786:x1870853265438336:12345-0@lo:104: Request processed in 41us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.179012:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784184820.179023:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784184820.179029:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5786:x1870853265438464:12345-0@lo:104: 00010000:00010000:2.0:1784184820.179035:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179128:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784184820.179135:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179144:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784184820.179148:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179157:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184820.179164:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184820.179169:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784184820.179209:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179215:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784184820.179233:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179239:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afe5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe63 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179254:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784184820.179257:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179269:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784184820.179271:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179278:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.179282:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1784184820.179284:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184820.179289:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784184820.179301:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179308:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784184820.179314:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.179321:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe2b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.179361:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784184820.179368:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5786:x1870853265438464:12345-0@lo:104: Request processed in 340us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.179376:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784184820.179513:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265438592:0@lo:103: 00000100:00100000:1.0:1784184820.179562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.179594:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184820.179599:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265438720:0@lo:103: 00000100:00100000:1.0:1784184820.179619:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.179648:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438592 00000100:00100000:1.0:1784184820.179653:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438592 00010000:00010000:1.0:1784184820.179683:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 17 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.179711:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438720 00000100:00100000:1.0:1784184820.179714:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438720 00010000:00010000:1.0:1784184820.179726:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 18 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.179737:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784184820.179892:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:3313:x1870853265438592:12345-0@lo:103: 00010000:00010000:1.0:1784184820.179905:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184820.179911:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 18 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.179941:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 18 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.179959:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184820.179984:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1784184820.179987:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:3313:x1870853265438592:12345-0@lo:103: Request processed in 244us (425us total) trans 0 rc 0/0 00010000:00010000:0.0:1784184820.179989:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.179993:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1784184820.179996:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f800 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784184820.179999:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.180006:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784184820.180011:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:3313:x1870853265438720:12345-0@lo:103: 00010000:00010000:0.0:1784184820.180016:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.180018:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184820.180023:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 17 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184820.180023:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184820.180029:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784184820.180031:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 17 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.180040:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184820.180049:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180055:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784184820.180058:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:3313:x1870853265438720:12345-0@lo:103: Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.180064:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1784184820.180067:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180073:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afdde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afde5 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180083:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784184820.180085:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180090:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc1d5bc20) 00000100:00100000:1.0:1784184820.180092:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265438720:0@lo:103: 10000000:00010000:0.0:1784184820.180093:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.180100:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265438592:0@lo:103: 00010000:00010000:0.0:1784184820.180100:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184820.180107:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184820.180117:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784184820.180128:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896e600/0x63160f6fbe8afe63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afe5c expref: 16 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180131:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180137:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784184820.180141:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265437952:0@lo:104: 00010000:00010000:0.0:1784184820.180143:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180149:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afdb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afdbb expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.180151:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8afe2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afe24 expref: 15 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.180157:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184820.180159:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184820.180161:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184820.180165:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438080:0@lo:104: 00000100:00100000:1.0:1784184820.180176:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438208:0@lo:104: 00000100:00100000:0.0:1784184820.180179:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265438848:0@lo:103: 00000100:00100000:1.0:1784184820.180183:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438336:0@lo:104: 00000100:00100000:1.0:1784184820.180190:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1870853265438464:0@lo:104: 00000100:00100000:0.0:1784184820.180203:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784184820.180209:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184820.180230:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184820.180236:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265438976:0@lo:103: 00000100:00100000:0.0:1784184820.180255:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.180279:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438976 00000100:00100000:1.0:1784184820.180283:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438976 00000100:00100000:2.0:1784184820.180284:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265438848 00000100:00100000:2.0:1784184820.180290:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265438848 00010000:00010000:1.0:1784184820.180298:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f80031a00/0x63160f6fbe8afdbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 16 pid: 5784 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.180309:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 16 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.180411:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784184820.180420:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3315:x1870853265438976:12345-0@lo:103: 00010000:00010000:1.0:1784184820.180428:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184820.180432:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f80031a00/0x63160f6fbe8afdbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 16 pid: 5784 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.180441:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f80031a00/0x63160f6fbe8afdbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 16 pid: 5784 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.180450:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f80031a00/0x63160f6fbe8afdbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afdb4 expref: 16 pid: 5784 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.180459:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184820.180486:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:3315:x1870853265438976:12345-0@lo:103: Request processed in 68us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.181612:0:5779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1784184820.181626:0:5779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1784184820.182450:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184820.182452:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265438976:0@lo:103: 00010000:00010000:2.0:1784184820.182461:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.182483:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f80030200 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784184820.182487:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.182496:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784184820.182503:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184820.182509:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784184820.182550:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.182556:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784184820.182573:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.182579:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8afe08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe0f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.182595:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184820.182597:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184820.182599:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184820.182605:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784184820.182617:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265439104:0@lo:103: 00000100:00100000:2.0:1784184820.182679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784184820.182960:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184820.182963:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184820.187494:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784184820.187522:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:3315:x1870853265438848:12345-0@lo:103: 00010000:00010000:3.0:1784184820.187570:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184820.187580:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 15 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.187594:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 15 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.187612:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8afde5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afdde expref: 15 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.187626:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184820.187708:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:3315:x1870853265438848:12345-0@lo:103: Request processed in 201us (7503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.187715:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784184820.188651:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784184820.188678:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265439104 00000100:00100000:3.0:1784184820.188688:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265439104 00010000:00010000:3.0:1784184820.188721:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 14 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184820.188740:0:5778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784184820.188756:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784184820.188764:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:3314:x1870853265439104:12345-0@lo:103: 00010000:00010000:3.0:1784184820.188774:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184820.188779:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 14 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188789:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 14 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188816:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afe08 expref: 14 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188831:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188839:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188853:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188860:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188866:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188873:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188879:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784184820.188883:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188890:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188919:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.188947:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184820.189000:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3314:x1870853265439104:12345-0@lo:103: Request processed in 237us (6321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.189007:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784184820.189060:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265439104:0@lo:103: 00010000:00010000:2.0:1784184820.189508:0:5786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.189516:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.189522:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afe78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784184820.189536:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784184820.191194:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784184820.191536:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265438848:0@lo:103: 00010000:00010000:0.0:1784184820.234557:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184820.277270:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:7485:x1870853265437824:12345-0@lo:253: Request processed in 132254us (132420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.277285:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784184820.277392:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265437824:0@lo:253: 10000000:01000000:0.0:1784184820.277407:0:7485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784184820.277410:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784184820.277412:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784184820.277424:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784184820.277426:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1784184820.277427:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784184820.277428:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784184820.277429:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784184820.277430:0:7485:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784184820.277432:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784184820.277433:0:7485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784184820.277456:0:7485:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b5fbfbf1800 from lustre-OST0001 10000000:01000000:0.0:1784184820.277479:0:7485:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1784184820.277482:0:7485:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784184820.277490:0:7485:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b5f90580000 local copy 10000000:01000000:0.0:1784184820.277494:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784184820.277533:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.277556:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.277566:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184820.277585:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439232:0@lo:101: 00000100:00100000:0.0:1784184820.277622:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184820.277682:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc1834240 going to sleep for 11 seconds 00000100:00100000:3.0:1784184820.277897:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265439232 00000100:00100000:3.0:1784184820.277903:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265439232 00000100:00100000:3.0:1784184820.277953:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784184820.277962:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+11:7485:x1870853265439232:12345-0@lo:101: 00010000:00010000:3.0:1784184820.277975:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184820.277989:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afe7f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.278008:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afe7f expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.278019:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe7f expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.278028:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a200, rc 0) 00000100:00100000:3.0:1784184820.278072:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439232:12345-0@lo:101: Request processed in 111us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.278078:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784184820.278213:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439232:0@lo:101: 00010000:00010000:1.0:1784184820.278227:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.278236:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.278370:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439360:0@lo:501: 00000100:00100000:1.0:1784184820.278398:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.278416:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784184820.278469:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265439360 00000100:00100000:2.0:1784184820.278473:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265439360 00000100:00100000:2.0:1784184820.278503:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784184820.278509:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439360:12345-0@lo:501: 00000100:00100000:2.0:1784184820.278956:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439360:12345-0@lo:501: Request processed in 446us (556us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784184820.278964:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784184820.279042:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439360:0@lo:501: 10000000:01000000:1.0:1784184820.279057:0:7485:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784184820.279084:0:7485:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784184820.279090:0:7485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.279098:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.279105:0:7485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.279125:0:7485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784184820.279150:0:7485:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b5fbfbf1800 10000000:01000000:1.0:1784184820.279155:0:7485:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784184820.279159:0:7485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784184820.279162:0:7485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784184820.279166:0:7485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784184820.279168:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784184820.279187:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.279194:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.279202:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.279215:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439488:0@lo:101: 00000100:00100000:1.0:1784184820.279242:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.279263:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1784184820.279833:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265439488 00000100:00100000:3.0:1784184820.279840:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265439488 00000100:00100000:3.0:1784184820.279875:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784184820.279882:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439488:12345-0@lo:101: 00010000:00010000:3.0:1784184820.279900:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184820.279910:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afe8d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.279940:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.279950:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184820.279958:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164ba00, rc 0) 00000100:00100000:3.0:1784184820.279994:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265439488:12345-0@lo:101: Request processed in 112us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.279999:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:2.0:1784184820.280062:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784184820.280069:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.280076:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784184820.280080:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.280088:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784184820.280094:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184820.280110:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784184820.280132:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.280138:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784184820.280161:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.280168:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631ca00/0x63160f6fbe8afe7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x63160f6fbe8afe86 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.280182:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184820.280184:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184820.280186:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184820.280285:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265439616:0@lo:103: 00000100:00100000:3.0:1784184820.280313:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.280555:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265439616 00000100:00100000:2.0:1784184820.280560:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265439616 00000100:00100000:2.0:1784184820.280679:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784184820.280687:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3314:x1870853265439616:12345-0@lo:103: 00010000:00010000:2.0:1784184820.280697:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184820.280710:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8afe86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8afe7f expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.280721:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184820.280822:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3314:x1870853265439616:12345-0@lo:103: Request processed in 135us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.280829:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784184820.280887:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265439616:0@lo:103: 00000100:00100000:1.0:1784184820.280972:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439488:0@lo:101: 00010000:00010000:1.0:1784184820.280987:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.280996:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.281097:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439744:0@lo:501: 00000100:00100000:1.0:1784184820.281129:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.281153:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.281170:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265439744 00000100:00100000:1.0:1784184820.281181:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265439744 00000100:00100000:1.0:1784184820.281204:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784184820.281210:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439744:12345-0@lo:501: 00000100:00100000:1.0:1784184820.281440:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439744:12345-0@lo:501: Request processed in 230us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.281448:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784184820.281479:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439744:0@lo:501: 00000100:00100000:1.0:1784184820.281503:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439872:0@lo:503: 00000100:00100000:1.0:1784184820.281539:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.281551:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.281562:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265439872 00000100:00100000:1.0:1784184820.281565:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265439872 00000100:00100000:1.0:1784184820.281583:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784184820.281589:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439872:12345-0@lo:503: 00000100:00100000:1.0:1784184820.281716:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265439872:12345-0@lo:503: Request processed in 127us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.281723:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784184820.283296:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265439872:0@lo:503: 00000040:00080000:1.0:1784184820.283643:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784184820.285174:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440000:0@lo:502: 00000100:00100000:1.0:1784184820.285263:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.285319:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1784184820.285849:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440000 00000100:00100000:3.0:1784184820.285857:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440000 00000100:00100000:3.0:1784184820.285906:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784184820.285915:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265440000:12345-0@lo:502: 00000100:00100000:3.0:1784184820.286137:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265440000:12345-0@lo:502: Request processed in 222us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.286145:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784184820.287976:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440000:0@lo:502: 00000040:00080000:1.0:1784184820.288288:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784184820.288401:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784184820.288438:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784184820.288497:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784184820.288531:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784184820.290109:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784184820.290169:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440128:0@lo:502: 00000100:00100000:1.0:1784184820.290250:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.290281:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1784184820.292107:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440128 00000100:00100000:3.0:1784184820.292120:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440128 00000100:00100000:3.0:1784184820.292188:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784184820.292198:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265440128:12345-0@lo:502: 00000100:00100000:3.0:1784184820.292486:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265440128:12345-0@lo:502: Request processed in 288us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.292496:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784184820.292688:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440128:0@lo:502: 00000040:00080000:0.0:1784184820.294081:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784184820.294102:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784184820.297876:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784184820.297888:0:7495:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784184820.297894:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184820.297896:0:7495:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784184820.297903:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784184820.297947:0:7495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b5fb93319c0) 00000020:00000080:3.0:1784184820.297972:0:7495:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784184820.297979:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784184820.298051:0:7495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fbfbf1800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784184820.298060:0:7495:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784184820.298065:0:7495:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63160f6fbe8afea2 00010000:00010000:3.0:1784184820.306112:0:7495:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1784184820.306435:0:7495:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784184820.310502:0:7495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784184820.311136:0:7495:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1784184820.320215:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784184820.320767:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1784184820.323855:0:7495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1784184820.323868:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784184820.323875:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784184820.323877:0:7495:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784184820.323881:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784184820.323885:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784184820.323886:0:7495:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784184820.323889:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784184820.323891:0:7495:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784184820.323954:0:7495:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784184820.323958:0:7495:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784184820.323960:0:7495:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784184820.323963:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784184820.324375:0:7485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1784184820.324398:0:7485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784184820.324418:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.324437:0:7485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184820.324443:0:7485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbfbf1800 from 1 10000000:01000000:0.0:1784184820.324445:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784184820.324479:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.324488:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184820.324500:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184820.324524:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440256:0@lo:101: 00000100:00100000:0.0:1784184820.324598:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184820.324632:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc1834900 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.334568:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440256 00000100:00100000:1.0:1784184820.334583:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440256 00000100:00100000:1.0:1784184820.334648:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784184820.334658:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:7485:x1870853265440256:12345-0@lo:101: 00010000:00010000:1.0:1784184820.334673:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184820.334690:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afea9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.334716:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.334727:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.334759:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e200, rc 0) 00000100:00100000:1.0:1784184820.334840:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440256:12345-0@lo:101: Request processed in 183us (10241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.334848:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784184820.334919:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440256:0@lo:101: 00010000:00010000:1.0:1784184820.334945:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.334956:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.335070:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440384:0@lo:501: 00000100:00100000:1.0:1784184820.335099:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.335126:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ebb300 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.335140:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440384 00000100:00100000:1.0:1784184820.335143:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440384 00000100:00100000:1.0:1784184820.335163:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784184820.335169:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440384:12345-0@lo:501: 00000100:00100000:1.0:1784184820.335772:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440384:12345-0@lo:501: Request processed in 601us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.335780:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784184820.335814:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440384:0@lo:501: 00000100:00100000:1.0:1784184820.335843:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440512:0@lo:503: 00000100:00100000:1.0:1784184820.335880:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.335893:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ebb300 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.335913:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440512 00000100:00100000:1.0:1784184820.335918:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440512 00000100:00100000:1.0:1784184820.335945:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784184820.335951:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440512:12345-0@lo:503: 00000100:00100000:1.0:1784184820.336225:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440512:12345-0@lo:503: Request processed in 273us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.336232:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784184820.336270:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440512:0@lo:503: 00000040:00080000:1.0:1784184820.336521:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784184820.337172:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440640:0@lo:502: 00000100:00100000:1.0:1784184820.337220:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.337243:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7be40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.337268:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440640 00000100:00100000:1.0:1784184820.337273:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440640 00000100:00100000:1.0:1784184820.337302:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784184820.337309:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440640:12345-0@lo:502: 00000100:00100000:1.0:1784184820.337511:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440640:12345-0@lo:502: Request processed in 201us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.337518:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784184820.337974:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440640:0@lo:502: 00000040:00080000:1.0:1784184820.338241:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784184820.338293:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784184820.338321:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440768:0@lo:502: 00000100:00100000:1.0:1784184820.341699:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.341845:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7be40 going to sleep for 11 seconds 00000100:00100000:3.0:1784184820.342656:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440768 00000100:00100000:3.0:1784184820.342666:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440768 00000100:00100000:0.0:1784184820.342992:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784184820.343003:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440768:12345-0@lo:502: 00000100:00100000:0.0:1784184820.343245:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440768:12345-0@lo:502: Request processed in 244us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184820.343254:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784184820.343380:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440768:0@lo:502: 00000040:00080000:2.0:1784184820.343541:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784184820.343580:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784184820.345179:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784184820.345191:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184820.345193:0:7499:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784184820.345201:0:7499:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fbfbf1800 00000020:00000080:3.0:1784184820.345204:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784184820.345225:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784184820.345227:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184820.345229:0:7499:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784184820.345232:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784184820.345393:0:7485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784184820.345418:0:7485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784184820.345441:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.345452:0:7485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184820.345492:0:7485:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784184820.345495:0:7485:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b5fbfbf1800 10000000:01000000:2.0:1784184820.345498:0:7485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b5fbfbf1800 10000000:01000000:2.0:1784184820.345501:0:7485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784184820.345507:0:7485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fbfbf1800 from 1 10000000:01000000:2.0:1784184820.345509:0:7485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784184820.345542:0:7485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.345560:0:7485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.345569:0:7485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184820.345591:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440896:0@lo:101: 00000100:00100000:2.0:1784184820.345647:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.345696:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.346061:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265440896 00000100:00100000:1.0:1784184820.346068:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265440896 00000100:00100000:1.0:1784184820.346113:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784184820.346121:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265440896:12345-0@lo:101: 00010000:00010000:1.0:1784184820.346135:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184820.346148:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afeb7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.346170:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.346181:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.346189:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896fa00, rc 0) 00000100:00100000:1.0:1784184820.346226:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265440896:12345-0@lo:101: Request processed in 106us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.346234:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784184820.346377:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265440896:0@lo:101: 00010000:00010000:2.0:1784184820.346392:0:7485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.346412:0:7485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184820.346495:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441024:0@lo:501: 00000100:00100000:2.0:1784184820.346520:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.346535:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.346676:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441024 00000100:00100000:1.0:1784184820.346680:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441024 00000100:00100000:1.0:1784184820.346701:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784184820.346708:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441024:12345-0@lo:501: 00000100:00100000:1.0:1784184820.347072:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441024:12345-0@lo:501: Request processed in 364us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.347079:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784184820.347143:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441024:0@lo:501: 00000100:00100000:2.0:1784184820.347172:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441152:0@lo:503: 00000100:00100000:2.0:1784184820.347205:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.347262:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184820.347366:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441152 00000100:00100000:0.0:1784184820.347370:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441152 00000100:00100000:0.0:1784184820.347395:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784184820.347401:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441152:12345-0@lo:503: 00000100:00100000:0.0:1784184820.347551:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441152:12345-0@lo:503: Request processed in 142us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184820.347564:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784184820.347708:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441152:0@lo:503: 00000040:00080000:2.0:1784184820.347970:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784184820.348021:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441280:0@lo:502: 00000100:00100000:2.0:1784184820.348054:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.348082:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184820.348194:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441280 00000100:00100000:0.0:1784184820.348199:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441280 00000100:00100000:0.0:1784184820.348218:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784184820.348223:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441280:12345-0@lo:502: 00000100:00100000:0.0:1784184820.348400:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441280:12345-0@lo:502: Request processed in 175us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184820.348407:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784184820.348558:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441280:0@lo:502: 00000040:00080000:2.0:1784184820.348950:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784184820.348998:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784184820.349029:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784184820.349070:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784184820.349102:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784184820.349145:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784184820.349179:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784184820.349211:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784184820.349253:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784184820.349285:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784184820.349327:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784184820.350292:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784184820.350360:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784184820.350400:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784184820.350465:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784184820.350503:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784184820.350538:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784184820.350582:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784184820.350618:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784184820.350650:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784184820.350821:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784184820.350860:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784184820.350892:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784184820.350948:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784184820.350982:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784184820.351014:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784184820.351058:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784184820.351094:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1784184820.351129:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784184820.351203:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1784184820.351252:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1784184820.351284:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1784184820.351314:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1784184820.351382:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1784184820.351416:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1784184820.351458:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1784184820.351489:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1784184820.351531:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441408:0@lo:502: 00000100:00100000:2.0:1784184820.351601:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.351644:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.351921:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441408 00000100:00100000:1.0:1784184820.351938:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441408 00000100:00100000:1.0:1784184820.351986:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784184820.351995:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441408:12345-0@lo:502: 00000100:00100000:1.0:1784184820.352224:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265441408:12345-0@lo:502: Request processed in 229us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.352239:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784184820.352462:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265441408:0@lo:502: 00000040:00080000:2.0:1784184820.352575:0:7485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1784184820.352587:0:7485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1784184820.354009:0:7500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784184820.354038:0:7500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b5fb7228000) 00000020:00000080:2.0:1784184820.354060:0:7500:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1784184820.354249:0:7500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fbfbf1800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784184820.354253:0:7500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5fbfbf1800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784184820.354256:0:7500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fbfbf1800 3 00010000:00080000:2.0:1784184820.354289:0:7500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5fbf642800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1784184820.356282:0:7500:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1784184820.356654:0:7500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784184820.356700:0:7500:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784184820.356713:0:7500:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x63160f6fbe8afecc 00000100:00080000:2.0:1784184820.356725:0:7500:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784184820.356732:0:7500:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b5fbf642800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784184820.356835:0:7500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fc13b6a00 x1870853265441536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784184820.356907:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1870853265441536:0@lo:38: 00000100:00100000:1.0:1784184820.357001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784184820.357111:0:7500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784184820.357204:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265441920:0@lo:400: 00000100:00100000:2.0:1784184820.357234:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184820.357361:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441536 00000100:00100000:3.0:1784184820.357368:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441536 00000100:00100000:3.0:1784184820.357401:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784184820.357410:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1870853265441536:12345-0@lo:38: 00010000:00080000:3.0:1784184820.357437:0:5793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1784184820.357471:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x63160f6fbe8afed3 00000004:00100000:3.0:1784184820.357490:0:5793:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784184820.357523:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9b5fb933d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784184820.357936:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265441664:0@lo:400: 00000100:00100000:0.0:1784184820.357967:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184820.357987:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184820.357993:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265441792:0@lo:400: 00000100:00100000:0.0:1784184820.358013:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184820.358041:0:5794:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784184820.358047:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784184820.358057:0:5792:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784184820.358062:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441664 00000100:00100000:0.0:1784184820.358066:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441664 00000100:00100000:0.0:1784184820.358088:0:5792:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784184820.358092:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441792 00000100:00100000:0.0:1784184820.358094:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441792 00000100:00100000:0.0:1784184820.358117:0:5792:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784184820.358123:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784184820.358128:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265441664:12345-0@lo:400: 00000100:00100000:0.0:1784184820.358166:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265441664:12345-0@lo:400: Request processed in 37us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184820.358173:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784184820.358185:0:5792:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784184820.358201:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784184820.358206:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265441792:12345-0@lo:400: 00000100:00100000:0.0:1784184820.358232:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265441792:12345-0@lo:400: Request processed in 26us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184820.358238:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1784184820.358270:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fc13b6680 x1870853265441792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184820.358282:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265441792:0@lo:400: 00010000:00080000:0.0:1784184820.358291:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fc13b7480 x1870853265441664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184820.358298:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265441664:0@lo:400: 00000100:00100000:3.0:1784184820.361708:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870853265441536:12345-0@lo:38: Request processed in 4289us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.361722:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784184820.362418:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265441920 00000100:00100000:2.0:1784184820.362428:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265441920 00000100:00100000:2.0:1784184820.362482:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784184820.362494:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265441920:12345-0@lo:400: 00000100:00100000:2.0:1784184820.362586:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265441920:12345-0@lo:400: Request processed in 96us (5351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184820.362593:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784184820.362653:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fc13b5f80 x1870853265441920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184820.362668:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265441920:0@lo:400: 00000040:00080000:2.0:1784184820.364058:0:7500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1784184820.364154:0:7485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1784184820.364177:0:7485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784184820.364192:0:7485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184820.364204:0:7485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784184820.364244:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784184820.364247:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784184820.364248:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784184820.364250:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784184820.364251:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784184820.364252:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784184820.364254:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784184820.364255:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784184820.364257:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784184820.364258:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784184820.364260:0:7485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784184820.364263:0:7485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1784184820.364265:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784184820.364267:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784184820.364268:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784184820.364269:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784184820.364270:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784184820.364271:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784184820.364272:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784184820.364273:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784184820.364273:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784184820.364274:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784184820.364275:0:7485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784184820.364301:0:7485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784184820.364317:0:7485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265442048:0@lo:253: 00000100:00100000:2.0:1784184820.364397:0:7485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184820.364432:0:7485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92000 going to sleep for 11 seconds 00000100:00080000:3.0:1784184820.364540:0:7502:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9b5fb89c2a00 x1870853265442176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184820.364618:0:7502:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1c00 going to sleep for 0 seconds 00010000:00080000:1.0:1784184820.365488:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fc13b6a00 x1870853265441536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784184830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184820.365501:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784184820.365511:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1784184820.365521:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784184820.365527:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784184820.365530:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fbf642800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1784184820.365538:0:3312:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006a604725): req@ffff9b5fb89c2a00 x1870853265442176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184820.365565:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1870853265441536:0@lo:38: 00000100:00100000:1.0:1784184820.365597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442048 00000100:00100000:1.0:1784184820.365602:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442048 00000100:00100000:1.0:1784184820.365646:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784184820.365655:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7485:x1870853265442048:12345-0@lo:253: 20000000:01000000:1.0:1784184820.365682:0:5784:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784184820.365695:0:5784:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1784184820.366256:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784184820.366263:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184820.367976:0:7502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184820.368025:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442176 00000100:00100000:3.0:1784184820.368032:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442176 00000100:00080000:1.0:1784184820.368053:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184820.368080:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784184820.368088:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7502:x1870853265442176:12345-0@lo:901: 00000100:00100000:3.0:1784184820.368425:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7502:x1870853265442176:12345-0@lo:901: Request processed in 336us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184820.368433:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784184820.368473:0:7502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fb89c2a00 x1870853265442176/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784184836 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184820.368488:0:7502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c2a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7502:1870853265442176:0@lo:901: 20000000:01000000:1.0:1784184820.391004:0:5784:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784184820.391017:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784184820.391037:0:5808:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784184820.391041:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784184820.391061:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391090:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391098:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391132:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391144:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 14 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.391159:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1870853265442304:0@lo:104: 00000100:00100000:1.0:1784184820.391222:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.391256:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184820.391274:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442304 00000100:00100000:1.0:1784184820.391280:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442304 00000100:00100000:1.0:1784184820.391322:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784184820.391353:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5808:x1870853265442304:12345-0@lo:104: 00010000:00010000:1.0:1784184820.391366:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391414:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784184820.391420:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:5808:x1870853265442304:12345-0@lo:104: Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.391426:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784184820.391458:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784184820.391464:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391478:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f80031800 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:1.0:1784184820.391481:0:7491:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391489:0:7491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184820.391496:0:7491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184820.391502:0:7491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784184820.391530:0:7491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391536:0:7491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184820.391565:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391571:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f80031800/0x63160f6fbe8afe16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe1d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391586:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184820.391588:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184820.391589:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184820.391606:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265442432:0@lo:103: 00000100:00100000:1.0:1784184820.391635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184820.391672:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442432 00000100:00100000:1.0:1784184820.391676:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442432 00010000:00010000:1.0:1784184820.391692:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 15 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.391719:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784184820.391725:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:3314:x1870853265442432:12345-0@lo:103: 00010000:00010000:1.0:1784184820.391735:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184820.391849:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 15 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391862:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 15 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391879:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391885:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784184820.391897:0:7492:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004396850s 00010000:00010000:1.0:1784184820.391901:0:7492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391908:0:7492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391915:0:7492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391922:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391938:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784184820.391943:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391957:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391965:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.391974:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184820.392004:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:3314:x1870853265442432:12345-0@lo:103: Request processed in 279us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184820.392010:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784184820.392076:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265442432:0@lo:103: 00010000:00010000:1.0:1784184820.392101:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8afe1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afe16 expref: 14 pid: 5786 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184820.392110:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1870853265442304:0@lo:104: 00010000:00010000:1.0:1784184820.392120:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.392127:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.392133:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184820.392139:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896f000/0x63160f6fbe8afeda lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184820.400245:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:7485:x1870853265442048:12345-0@lo:253: Request processed in 34581us (35839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184820.400260:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784184820.400384:0:7485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7485:1870853265442048:0@lo:253: 10000000:01000000:1.0:1784184820.400415:0:7485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784184820.400418:0:7485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784184820.400420:0:7485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784184820.400421:0:7485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784184820.400423:0:7485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784184820.400424:0:7485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784184820.400426:0:7485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784184820.400427:0:7485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784184820.400429:0:7485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784184820.400431:0:7485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784184820.400432:0:7485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784184820.400434:0:7485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784184820.400453:0:7485:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784184820.405119:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784184820.405286:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784184820.405613:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784184820.405813:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784184820.406003:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784184820.406202:0:7485:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784184820.407269:0:7485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1784184820.643898:0:7485:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784184820.643906:0:7485:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784184820.643989:0:7485:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784184820.644046:0:7485:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784184820.644063:0:7485:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784184820.644092:0:7485:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1784184821.268430:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184822.283986:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184822.987454:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784184822.987480:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265442560:0@lo:13: 00000100:00100000:1.0:1784184822.987558:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184822.987687:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442560 00000100:00100000:2.0:1784184822.987694:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442560 00000100:00100000:2.0:1784184822.987755:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784184822.987765:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265442560:12345-0@lo:13: 00002000:00000024:2.0:1784184822.987806:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184822.987856:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265442560:12345-0@lo:13: Request processed in 92us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184822.987863:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1784184822.987981:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784184822.988023:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b6d80 x1870853265442560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184822.988041:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265442560:0@lo:13: 00010000:00010000:1.0:1784184823.306680:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184824.331469:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184825.359963:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184825.549197:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265443072:0@lo:400: 00000100:00100000:0.0:1784184825.549258:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184825.549315:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784184825.549320:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265442688:0@lo:400: 00000100:00100000:0.0:1784184825.549375:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184825.549393:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265443200:0@lo:400: 00000100:00100000:0.0:1784184825.549415:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184825.549435:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265442816:0@lo:400: 00000100:00100000:0.0:1784184825.549452:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184825.549481:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184825.549499:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265442944:0@lo:400: 00000100:00100000:0.0:1784184825.549518:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184825.549587:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443072 00000100:00100000:0.0:1784184825.549594:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443072 00000100:00100000:0.0:1784184825.549642:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784184825.549649:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265443072:12345-0@lo:400: 00000100:00100000:0.0:1784184825.549697:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265443072:12345-0@lo:400: Request processed in 48us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184825.549704:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784184825.549765:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443200 00000100:00100000:0.0:1784184825.549769:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443200 00000100:00100000:0.0:1784184825.549792:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442816 00000100:00100000:0.0:1784184825.549795:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442816 00000100:00100000:0.0:1784184825.549806:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442944 00000100:00100000:0.0:1784184825.549807:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442944 00000100:00100000:0.0:1784184825.549820:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784184825.549825:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265443200:12345-0@lo:400: 00000100:00100000:0.0:1784184825.549867:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265443200:12345-0@lo:400: Request processed in 42us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184825.549873:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784184825.549885:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784184825.549891:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265442816:12345-0@lo:400: 00000100:00100000:0.0:1784184825.549920:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265442816:12345-0@lo:400: Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184825.549927:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784184825.549938:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784184825.549943:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265442944:12345-0@lo:400: 00000100:00100000:0.0:1784184825.549966:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265442944:12345-0@lo:400: Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184825.549978:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1784184825.550002:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784184825.550006:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184825.550034:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a7100 x1870853265442944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184825.550047:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265442944:0@lo:400: 00010000:00080000:0.0:1784184825.550058:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a6300 x1870853265442816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184825.550065:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265442816:0@lo:400: 00010000:00080000:0.0:1784184825.550092:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a4e00 x1870853265443200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184825.550099:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265443200:0@lo:400: 00010000:00080000:0.0:1784184825.550107:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a4000 x1870853265443072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184825.550114:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265443072:0@lo:400: 00000100:00100000:3.0:1784184825.550379:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265442688 00000100:00100000:3.0:1784184825.550383:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265442688 00000100:00100000:3.0:1784184825.550421:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784184825.550428:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3315:x1870853265442688:12345-0@lo:400: 00000100:00100000:3.0:1784184825.550478:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3315:x1870853265442688:12345-0@lo:400: Request processed in 50us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184825.550484:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784184825.550526:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265442688:0@lo:400: 00010000:00010000:0.0:1784184826.378573:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784184826.571504:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784184826.571511:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fc0d20000 from 30 10000000:01000000:1.0:1784184826.571517:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784184826.571558:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.571572:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.571583:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184826.571607:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443328:0@lo:101: 00000100:00100000:1.0:1784184826.571685:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.571730:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352900 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.571771:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443328 00000100:00100000:1.0:1784184826.571777:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443328 00000100:00100000:1.0:1784184826.572552:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784184826.572562:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265443328:12345-0@lo:101: 00010000:00010000:1.0:1784184826.572576:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184826.572590:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afee1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.572614:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.572649:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.572669:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ee00, rc 0) 00000100:00100000:1.0:1784184826.572718:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265443328:12345-0@lo:101: Request processed in 157us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.572725:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784184826.572776:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443328:0@lo:101: 00010000:00010000:1.0:1784184826.572793:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.572802:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184826.572866:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443456:0@lo:501: 00000100:00100000:1.0:1784184826.572894:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.572910:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352900 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.572923:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443456 00000100:00100000:1.0:1784184826.572927:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443456 00000100:00100000:1.0:1784184826.572947:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784184826.572954:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265443456:12345-0@lo:501: 00000100:00100000:1.0:1784184826.573286:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265443456:12345-0@lo:501: Request processed in 332us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.573293:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784184826.573323:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443456:0@lo:501: 00000100:00100000:1.0:1784184826.573367:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443584:0@lo:503: 00000100:00100000:1.0:1784184826.573405:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.573419:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352900 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.573437:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443584 00000100:00100000:1.0:1784184826.573452:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443584 00000100:00100000:1.0:1784184826.573473:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784184826.573479:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265443584:12345-0@lo:503: 00000100:00100000:1.0:1784184826.573737:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265443584:12345-0@lo:503: Request processed in 257us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.573743:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784184826.573779:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443584:0@lo:503: 00000100:00100000:1.0:1784184826.573999:0:7807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7807:1870853265443712:0@lo:502: 00000100:00100000:1.0:1784184826.574031:0:7807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.574054:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443712 00000100:00100000:1.0:1784184826.574058:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443712 00000100:00100000:1.0:1784184826.574078:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784184826.574083:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7807:x1870853265443712:12345-0@lo:502: 00000100:00100000:1.0:1784184826.574279:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7807:x1870853265443712:12345-0@lo:502: Request processed in 194us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.574286:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784184826.574317:0:7807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352300 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.574352:0:7807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7807:1870853265443712:0@lo:502: 00000100:00100000:1.0:1784184826.574391:0:7807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7807:1870853265443840:0@lo:502: 00000100:00100000:1.0:1784184826.574422:0:7807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.574440:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443840 00000100:00100000:1.0:1784184826.574444:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443840 00000100:00100000:1.0:1784184826.574463:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784184826.574469:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7807:x1870853265443840:12345-0@lo:502: 00000100:00100000:1.0:1784184826.574589:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:7807:x1870853265443840:12345-0@lo:502: Request processed in 119us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.574601:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784184826.574627:0:7807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352300 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.574640:0:7807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7807:1870853265443840:0@lo:502: 00000040:00080000:1.0:1784184826.574657:0:7807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784184826.574703:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784184826.574718:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784184826.574725:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.574734:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184826.574742:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784184826.574745:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1784184826.574747:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784184826.574767:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.574775:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.574783:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184826.574795:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443968:0@lo:101: 00000100:00100000:1.0:1784184826.574820:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.574846:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352300 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.574857:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265443968 00000100:00100000:1.0:1784184826.574860:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265443968 00000100:00100000:1.0:1784184826.574886:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784184826.574892:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265443968:12345-0@lo:101: 00010000:00010000:1.0:1784184826.574900:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184826.574910:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afeef expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.574929:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.574940:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.574949:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ec00, rc 0) 00000100:00100000:1.0:1784184826.574977:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265443968:12345-0@lo:101: Request processed in 85us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.574982:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784184826.575011:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265443968:0@lo:101: 00010000:00010000:1.0:1784184826.575022:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.575030:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184826.575063:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444096:0@lo:501: 00000100:00100000:1.0:1784184826.575086:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.575098:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352300 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.575108:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444096 00000100:00100000:1.0:1784184826.575111:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444096 00000100:00100000:1.0:1784184826.575130:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784184826.575143:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265444096:12345-0@lo:501: 00000100:00100000:1.0:1784184826.575360:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265444096:12345-0@lo:501: Request processed in 217us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.575366:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784184826.575396:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444096:0@lo:501: 00000100:00100000:1.0:1784184826.575419:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444224:0@lo:503: 00000100:00100000:1.0:1784184826.575448:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.575461:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352300 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.575471:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444224 00000100:00100000:1.0:1784184826.575475:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444224 00000100:00100000:1.0:1784184826.575493:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784184826.575499:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265444224:12345-0@lo:503: 00000100:00100000:1.0:1784184826.575755:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265444224:12345-0@lo:503: Request processed in 255us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.575762:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784184826.575797:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444224:0@lo:503: 00000100:00100000:2.0:1784184826.579128:0:7808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7808:1870853265444352:0@lo:502: 00000100:00100000:2.0:1784184826.579207:0:7808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.579243:0:7808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9540 going to sleep for 11 seconds 00000100:00100000:1.0:1784184826.579312:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444352 00000100:00100000:1.0:1784184826.579319:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444352 00000100:00100000:1.0:1784184826.579377:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784184826.579385:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:7808:x1870853265444352:12345-0@lo:502: 00000100:00100000:1.0:1784184826.579843:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:7808:x1870853265444352:12345-0@lo:502: Request processed in 458us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184826.579852:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784184826.580104:0:7808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7808:1870853265444352:0@lo:502: 00000020:01000000:2.0:1784184826.580136:0:7808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784184826.580144:0:7808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184826.580147:0:7808:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784184826.580151:0:7808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784184826.580153:0:7808:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784184826.580172:0:7808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7808:1870853265444480:0@lo:502: 00000100:00100000:2.0:1784184826.580208:0:7808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.580229:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444480 00000100:00100000:2.0:1784184826.580239:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444480 00000100:00100000:2.0:1784184826.580264:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784184826.580270:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:7808:x1870853265444480:12345-0@lo:502: 00000100:00100000:2.0:1784184826.580415:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:7808:x1870853265444480:12345-0@lo:502: Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.580422:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784184826.580525:0:7808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc1834780 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.580539:0:7808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7808:1870853265444480:0@lo:502: 00000020:01000000:2.0:1784184826.580556:0:7808:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184826.580561:0:7808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184826.580562:0:7808:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784184826.580565:0:7808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1784184826.580865:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1784184826.580883:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784184826.580893:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.580912:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184826.580922:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784184826.580924:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5f85958000 from 30 10000000:01000000:1.0:1784184826.580927:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784184826.580952:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.580959:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.580967:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184826.580980:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444608:0@lo:101: 00000100:00100000:1.0:1784184826.581008:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.581032:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352300 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.581090:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444608 00000100:00100000:2.0:1784184826.581096:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444608 00000100:00100000:2.0:1784184826.581121:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784184826.581127:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265444608:12345-0@lo:101: 00010000:00010000:2.0:1784184826.581136:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184826.581148:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afefd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.581168:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.581180:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.581188:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971a00, rc 0) 00000100:00100000:2.0:1784184826.581224:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265444608:12345-0@lo:101: Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.581238:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784184826.581304:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444608:0@lo:101: 00010000:00010000:1.0:1784184826.581317:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184826.581326:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184826.581393:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444736:0@lo:501: 00000100:00100000:1.0:1784184826.581417:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184826.581517:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87352300 going to sleep for 11 seconds 00000100:00100000:0.0:1784184826.582554:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444736 00000100:00100000:0.0:1784184826.582562:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444736 00000100:00100000:0.0:1784184826.582610:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784184826.582618:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265444736:12345-0@lo:501: 00000100:00100000:0.0:1784184826.583000:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265444736:12345-0@lo:501: Request processed in 382us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.583007:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784184826.583052:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444736:0@lo:501: 00000100:00100000:0.0:1784184826.583097:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444864:0@lo:503: 00000100:00100000:0.0:1784184826.583134:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.583158:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92000 going to sleep for 11 seconds 00000100:00100000:0.0:1784184826.583170:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444864 00000100:00100000:0.0:1784184826.583174:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444864 00000100:00100000:0.0:1784184826.583196:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784184826.583202:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265444864:12345-0@lo:503: 00000100:00100000:0.0:1784184826.583364:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265444864:12345-0@lo:503: Request processed in 161us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.583370:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784184826.583405:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265444864:0@lo:503: 00000100:00100000:2.0:1784184826.585324:0:7809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7809:1870853265444992:0@lo:502: 00000100:00100000:2.0:1784184826.585583:0:7809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.586583:0:7809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9540 going to sleep for 11 seconds 00000100:00100000:0.0:1784184826.586772:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265444992 00000100:00100000:0.0:1784184826.586779:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265444992 00000100:00100000:0.0:1784184826.586836:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784184826.586845:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:7809:x1870853265444992:12345-0@lo:502: 00000100:00100000:0.0:1784184826.587094:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:7809:x1870853265444992:12345-0@lo:502: Request processed in 249us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.587102:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784184826.590705:0:7809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7809:1870853265444992:0@lo:502: 00000100:00100000:0.0:1784184826.590790:0:7809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7809:1870853265445120:0@lo:502: 00000100:00100000:0.0:1784184826.590867:0:7809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.590906:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265445120 00000100:00100000:0.0:1784184826.590913:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265445120 00000100:00100000:0.0:1784184826.590962:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784184826.590972:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:7809:x1870853265445120:12345-0@lo:502: 00000100:00100000:0.0:1784184826.591213:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:7809:x1870853265445120:12345-0@lo:502: Request processed in 241us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.591222:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784184826.591271:0:7809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784184826.591283:0:7809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7809:1870853265445120:0@lo:502: 00000040:00080000:0.0:1784184826.591307:0:7809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784184826.591384:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784184826.591404:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784184826.591413:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184826.591423:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184826.591431:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784184826.591434:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5f85958000 from 5 10000000:01000000:0.0:1784184826.591436:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784184826.591475:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184826.591483:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184826.591493:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184826.591507:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445248:0@lo:101: 00000100:00100000:0.0:1784184826.591532:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.591555:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.593097:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265445248 00000100:00100000:2.0:1784184826.593108:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265445248 00000100:00100000:2.0:1784184826.593156:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784184826.593165:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265445248:12345-0@lo:101: 00010000:00010000:2.0:1784184826.593179:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184826.593196:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970c00/0x63160f6fbe8aff12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8aff0b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.593218:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970c00/0x63160f6fbe8aff12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8aff0b expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.593227:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970c00/0x63160f6fbe8aff12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8aff0b expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.593236:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970c00, rc 0) 00000100:00100000:2.0:1784184826.593292:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265445248:12345-0@lo:101: Request processed in 129us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.593299:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784184826.593362:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445248:0@lo:101: 00010000:00010000:2.0:1784184826.593378:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.593387:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184826.593464:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445376:0@lo:256: 00000100:00100000:2.0:1784184826.593498:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.593523:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c85840 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.593536:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265445376 00000100:00100000:2.0:1784184826.593539:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265445376 00000100:00100000:2.0:1784184826.593560:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784184826.593566:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265445376:12345-0@lo:256: 20000000:01000000:2.0:1784184826.593580:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784184826.593606:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784184826.593609:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1784184826.594260:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265445376:12345-0@lo:256: Request processed in 692us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.594267:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784184826.594306:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445376:0@lo:256: 10000000:01000000:2.0:1784184826.594414:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784184826.594422:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.594430:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184826.594448:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784184826.594451:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1784184826.594454:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784184826.594477:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.594493:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.594502:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184826.594516:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445504:0@lo:101: 00000100:00100000:2.0:1784184826.594541:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.594566:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c85840 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.594580:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265445504 00000100:00100000:2.0:1784184826.594600:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265445504 00000100:00100000:2.0:1784184826.594627:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784184826.594632:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265445504:12345-0@lo:101: 00010000:00010000:2.0:1784184826.594760:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184826.594773:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8aff19 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.594793:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.594803:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.594811:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970000, rc 0) 00000100:00100000:2.0:1784184826.594851:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265445504:12345-0@lo:101: Request processed in 218us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.594857:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784184826.594889:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445504:0@lo:101: 00010000:00010000:2.0:1784184826.594907:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.594917:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184826.594961:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445632:0@lo:501: 00000100:00100000:2.0:1784184826.594984:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.594997:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f872556c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.595007:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265445632 00000100:00100000:2.0:1784184826.595010:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265445632 00000100:00100000:2.0:1784184826.595030:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784184826.595035:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265445632:12345-0@lo:501: 00000100:00100000:2.0:1784184826.595266:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265445632:12345-0@lo:501: Request processed in 230us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.595274:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784184826.595301:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445632:0@lo:501: 00000100:00100000:2.0:1784184826.595326:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445760:0@lo:503: 00000100:00100000:2.0:1784184826.595388:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.595405:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f872556c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.595415:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265445760 00000100:00100000:2.0:1784184826.595418:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265445760 00000100:00100000:2.0:1784184826.595438:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784184826.595714:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265445760:12345-0@lo:503: 00000100:00100000:2.0:1784184826.595994:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265445760:12345-0@lo:503: Request processed in 282us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.599845:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265445760:0@lo:503: 00000100:00100000:0.0:1784184826.600090:0:7810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7810:1870853265445888:0@lo:502: 00000100:00100000:0.0:1784184826.600156:0:7810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.600192:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265445888 00000100:00100000:0.0:1784184826.600198:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265445888 00000100:00100000:0.0:1784184826.600233:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784184826.600241:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:7810:x1870853265445888:12345-0@lo:502: 00000100:00100000:0.0:1784184826.601865:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:7810:x1870853265445888:12345-0@lo:502: Request processed in 1618us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.601878:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784184826.601943:0:7810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92900 going to sleep for 11 seconds 00000100:00100000:0.0:1784184826.601967:0:7810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7810:1870853265445888:0@lo:502: 00000020:01000000:0.0:1784184826.602001:0:7810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784184826.602009:0:7810:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784184826.602015:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184826.602017:0:7810:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784184826.602022:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784184826.602026:0:7810:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:0.0:1784184826.602046:0:7810:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784184826.602049:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784184826.602063:0:7810:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b5fb74c3380) 00000020:00000080:0.0:1784184826.602085:0:7810:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784184826.602091:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784184826.602165:0:7810:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784184826.602170:0:7810:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784184826.602176:0:7810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8aff2e 00010000:00080000:0.0:1784184826.602217:0:7810:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5e813e3800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00000100:00100000:2.0:1784184826.602696:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00010000:0.0:1784184826.602835:0:7810:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1784184826.603163:0:7810:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784184826.603175:0:7810:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784184826.603728:0:7810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784184826.603957:0:7810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784184826.604013:0:7810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784184826.604075:0:7810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1784184826.604968:0:7811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784184826.604977:0:7811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784184826.606445:0:7810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784184826.606456:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784184826.606490:0:7810:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784184826.606514:0:7810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8aff35 00000100:00080000:0.0:1784184826.606523:0:7810:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784184826.606528:0:7810:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b5e813e3800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1784184826.606562:0:7810:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fb74a4e00 x1870853265446016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784184826.606584:0:7810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1784184826.606694:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265446144:0@lo:400: 00000100:00100000:0.0:1784184826.606772:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.606809:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184826.606815:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265446272:0@lo:400: 00000100:00100000:0.0:1784184826.606850:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.606894:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446144 00000100:00100000:0.0:1784184826.606900:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446144 00000100:00100000:0.0:1784184826.606934:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446272 00000100:00100000:0.0:1784184826.606936:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446272 00000100:00100000:0.0:1784184826.606956:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784184826.606964:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265446144:12345-0@lo:400: 00000100:00100000:0.0:1784184826.607011:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265446144:12345-0@lo:400: Request processed in 47us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.607024:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784184826.607041:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784184826.607046:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265446272:12345-0@lo:400: 00000100:00100000:0.0:1784184826.607074:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265446272:12345-0@lo:400: Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.607079:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1784184826.607114:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a7100 x1870853265446272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184826.607126:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265446272:0@lo:400: 00010000:00080000:0.0:1784184826.607136:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a6300 x1870853265446144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184826.607143:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265446144:0@lo:400: 00000020:01000000:0.0:1784184826.607208:0:7810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784184826.607213:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184826.607215:0:7810:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784184826.607218:0:7810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784184826.607223:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184826.607224:0:7810:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784184826.607227:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784184826.607229:0:7810:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784184826.607252:0:7810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7810:1870853265446656:0@lo:502: 00000100:00100000:0.0:1784184826.607291:0:7810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.607312:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446656 00000100:00100000:0.0:1784184826.607316:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446656 00000100:00100000:0.0:1784184826.607360:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784184826.607367:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:7810:x1870853265446656:12345-0@lo:502: 00000100:00100000:0.0:1784184826.607580:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:7810:x1870853265446656:12345-0@lo:502: Request processed in 213us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184826.607587:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784184826.607630:0:7810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9240 going to sleep for 11 seconds 00000100:00100000:0.0:1784184826.607642:0:7810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:7810:1870853265446656:0@lo:502: 00000020:01000000:0.0:1784184826.607664:0:7810:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784184826.607669:0:7810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184826.607670:0:7810:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784184826.607673:0:7810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1784184826.607720:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1784184826.607738:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784184826.607747:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184826.607758:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184826.607767:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784184826.607769:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b5f90580000 from 1 10000000:01000000:0.0:1784184826.607771:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784184826.607795:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184826.607801:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184826.607810:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184826.607821:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265446784:0@lo:101: 00000100:00100000:0.0:1784184826.607865:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.607876:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.608629:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265446016:0@lo:8: 00000100:00100000:2.0:1784184826.608688:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.608741:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446784 00000100:00100000:2.0:1784184826.608746:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446784 00000100:00100000:2.0:1784184826.608785:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784184826.608793:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265446784:12345-0@lo:101: 00010000:00010000:2.0:1784184826.608802:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184826.608814:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8aff3c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.608845:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.608855:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.608862:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970e00, rc 0) 00000100:00100000:2.0:1784184826.608896:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265446784:12345-0@lo:101: Request processed in 104us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.608901:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784184826.608932:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446016 00000100:00100000:2.0:1784184826.608935:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446016 00000100:00100000:2.0:1784184826.608952:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784184826.608956:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1870853265446016:12345-0@lo:8: 00010000:00080000:2.0:1784184826.608977:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1784184826.609001:0:6589:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8aff4a 00002000:00100000:2.0:1784184826.609014:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b5fb741c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784184826.609018:0:6589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1784184826.609031:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784184826.609141:0:6589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784184826.609285:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784184826.609307:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5fb741d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784184826.609380:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1870853265446016:12345-0@lo:8: Request processed in 422us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.609387:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784184826.609425:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a4e00 x1870853265446016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784184836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184826.609435:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784184826.609444:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784184826.609451:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784184826.609457:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784184826.609459:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5e813e3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784184826.609467:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784184826.609472:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265446016:0@lo:8: 00000100:00100000:2.0:1784184826.609506:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265446784:0@lo:101: 00010000:00010000:2.0:1784184826.609522:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.609532:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184826.609581:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265446912:0@lo:501: 00000100:00100000:2.0:1784184826.609606:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184826.609628:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c85b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784184826.609640:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446912 00000100:00100000:2.0:1784184826.609650:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446912 00000100:00100000:2.0:1784184826.609673:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784184826.609679:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265446912:12345-0@lo:501: 00000100:00100000:2.0:1784184826.609886:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265446912:12345-0@lo:501: Request processed in 207us (278us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784184826.609894:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784184826.609925:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265446912:0@lo:501: 10000000:01000000:2.0:1784184826.609944:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784184826.609950:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184826.609957:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784184826.612131:0:7811:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784184826.612383:0:7811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 224778049828ns, next at 0ns, rc = 0 00000100:00100000:3.0:1784184826.616530:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265446400:0@lo:400: 00000100:00100000:3.0:1784184826.616611:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184826.616671:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784184826.616679:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265446528:0@lo:400: 00000100:00100000:3.0:1784184826.616704:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184826.616743:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446528 00000100:00100000:3.0:1784184826.616751:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446528 00000100:00100000:3.0:1784184826.616797:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784184826.616807:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265446528:12345-0@lo:400: 00000100:00100000:3.0:1784184826.616871:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265446528:12345-0@lo:400: Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184826.616880:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1784184826.617194:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a4a80 x1870853265446528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184826.617207:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265446528:0@lo:400: 00000100:00100000:2.0:1784184826.622429:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265446400 00000100:00100000:2.0:1784184826.622451:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265446400 00000100:00100000:2.0:1784184826.622511:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784184826.622521:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265446400:12345-0@lo:400: 00000100:00100000:2.0:1784184826.622633:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265446400:12345-0@lo:400: Request processed in 113us (6021us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184826.622820:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784184826.622883:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a4000 x1870853265446400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184826.622898:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265446400:0@lo:400: 00000004:00080000:3.0:1784184826.668485:0:7812:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1784184826.668517:0:7812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265447168:0@lo:7: 00000100:00100000:3.0:1784184826.668584:0:7812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184826.668611:0:7812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f91fd6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784184826.668766:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265447040:0@lo:13: 00000100:00100000:3.0:1784184826.668796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184826.668853:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447168 00000100:00100000:3.0:1784184826.668860:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447168 00000100:00100000:3.0:1784184826.668909:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784184826.668918:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7812:x1870853265447168:12345-0@lo:7: 00002000:00080000:3.0:1784184826.676104:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1784184826.676113:0:6590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784184826.676214:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7812:x1870853265447168:12345-0@lo:7: Request processed in 7293us (7626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184826.676226:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784184826.676272:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447040 00000100:00100000:3.0:1784184826.676279:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447040 00000100:00100000:3.0:1784184826.676320:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784184826.676357:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265447040:12345-0@lo:13: 00002000:00000024:3.0:1784184826.676390:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1784184826.676428:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265447040:12345-0@lo:13: Request processed in 100us (7632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184826.676434:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784184826.676752:0:7812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb89c1500 x1870853265447168/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784184842 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184826.676768:0:7812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265447168:0@lo:7: 00000004:00080000:0.0:1784184826.676782:0:7812:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784184826.676820:0:7812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265447296:0@lo:5: 00000100:00100000:0.0:1784184826.676869:0:7812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184826.676902:0:7812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184826.676918:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447296 00000100:00100000:0.0:1784184826.676923:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447296 00000100:00100000:0.0:1784184826.676949:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784184826.676955:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7812:x1870853265447296:12345-0@lo:5: 00002000:00080000:0.0:1784184826.676980:0:6589:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1784184826.676985:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1784184826.677301:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:7812:x1870853265447296:12345-0@lo:5: Request processed in 345us (430us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784184826.677307:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784184826.677354:0:7812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d2a00 x1870853265447296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784184842 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184826.677363:0:7812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265447296:0@lo:5: 00000004:00080000:0.0:1784184826.677371:0:7812:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00080000:3.0:1784184826.677513:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784184826.677548:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb89c1f80 x1870853265447040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184826.677565:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265447040:0@lo:13: 00000004:00080000:2.0:1784184826.719551:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:3.0:1784184827.048201:0:7852:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784184827.411966:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184828.116294:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265447424:0@lo:13: 00000100:00100000:0.0:1784184828.116442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184828.118260:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447424 00000100:00100000:1.0:1784184828.118280:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447424 00000100:00100000:1.0:1784184828.118382:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784184828.118394:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265447424:12345-0@lo:13: 00002000:00000024:1.0:1784184828.118446:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784184828.120062:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184828.123270:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265447424:12345-0@lo:13: Request processed in 4864us (6813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184828.123290:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784184828.133957:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb89c1f80 x1870853265447424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184828.133992:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265447424:0@lo:13: 00010000:00010000:3.0:1784184828.427885:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184829.455772:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184830.474753:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784184831.320301:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1784184831.320353:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784184831.504371:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184831.690553:0:7812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265447680:0@lo:700: 00000100:00100000:0.0:1784184831.690628:0:7812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184831.690717:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265447552:0@lo:13: 00000100:00100000:2.0:1784184831.690760:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184831.690852:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447552 00000100:00100000:3.0:1784184831.690860:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447552 00000100:00100000:0.0:1784184831.691200:0:7812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87c9f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784184831.691314:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265447936:0@lo:400: 00000100:00100000:0.0:1784184831.691363:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184831.691387:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184831.691393:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265448064:0@lo:400: 00000100:00100000:0.0:1784184831.691415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184831.691448:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447936 00000100:00100000:0.0:1784184831.691452:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447936 00000100:00100000:0.0:1784184831.691486:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448064 00000100:00100000:0.0:1784184831.691489:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448064 00000100:00100000:0.0:1784184831.691511:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784184831.691519:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265447936:12345-0@lo:400: 00000100:00100000:0.0:1784184831.691573:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265447936:12345-0@lo:400: Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184831.691580:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784184831.691595:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784184831.691601:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265448064:12345-0@lo:400: 00000100:00100000:0.0:1784184831.691627:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265448064:12345-0@lo:400: Request processed in 27us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184831.691649:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1784184831.691690:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d3100 x1870853265448064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184831.691702:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265448064:0@lo:400: 00010000:00080000:0.0:1784184831.691712:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d3b80 x1870853265447936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184831.691719:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265447936:0@lo:400: 00000100:00100000:0.0:1784184831.691751:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265447808:0@lo:400: 00000100:00100000:0.0:1784184831.691782:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184831.691803:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265448320:0@lo:400: 00000100:00100000:0.0:1784184831.691822:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184831.691838:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184831.691842:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265448192:0@lo:400: 00000100:00100000:0.0:1784184831.691862:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184831.691886:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447808 00000100:00100000:0.0:1784184831.691890:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447808 00000100:00100000:0.0:1784184831.692436:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784184831.692444:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265447808:12345-0@lo:400: 00000100:00100000:0.0:1784184831.692483:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265447808:12345-0@lo:400: Request processed in 40us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184831.692489:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784184831.692513:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448320 00000100:00100000:0.0:1784184831.692516:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448320 00000100:00100000:0.0:1784184831.692539:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784184831.692545:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265448320:12345-0@lo:400: 00000100:00100000:0.0:1784184831.692581:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265448320:12345-0@lo:400: Request processed in 36us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184831.692586:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784184831.692603:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448192 00000100:00100000:0.0:1784184831.692607:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448192 00000100:00100000:0.0:1784184831.692631:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784184831.692636:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265448192:12345-0@lo:400: 00000100:00100000:0.0:1784184831.692663:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265448192:12345-0@lo:400: Request processed in 27us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184831.692669:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784184831.692699:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d2300 x1870853265448192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184831.692711:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265448192:0@lo:400: 00000100:00100000:0.0:1784184831.692720:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265447808:0@lo:400: 00010000:00080000:0.0:1784184831.692729:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d0a80 x1870853265448320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784184847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184831.692738:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265448320:0@lo:400: 00000100:00100000:2.0:1784184831.693419:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265447680 00000100:00100000:2.0:1784184831.693425:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265447680 00000100:00100000:2.0:1784184831.693453:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784184831.693461:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:7812:x1870853265447680:12345-0@lo:700: 00000100:00100000:2.0:1784184831.693503:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6597:1870853265448448:0@lo:700: 00000100:00100000:2.0:1784184831.693538:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184831.693557:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784184831.693574:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448448 00000100:00100000:2.0:1784184831.693577:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448448 00000100:00100000:2.0:1784184831.693602:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784184831.693609:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6597:x1870853265448448:12345-0@lo:700: 00000100:00100000:3.0:1784184831.703671:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784184831.703695:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265447552:12345-0@lo:13: 00002000:00000024:3.0:1784184831.703750:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184831.703832:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265447552:12345-0@lo:13: Request processed in 148us (13071us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184831.703838:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1784184831.703868:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784184831.703873:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784184831.703876:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784184831.703940:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d1f80 x1870853265447552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184831.703952:0:3315:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784184831.703974:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265447552:0@lo:13: 40000000:02000000:2.0:1784184831.766236:0:5799:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1784184831.776656:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6597:x1870853265448448:12345-0@lo:700: Request processed in 83039us (83109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184831.776671:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784184831.778081:0:6597:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b7480 x1870853265448448/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784184847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184831.778098:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6597:1870853265448448:0@lo:700: 40000000:02000000:0.0:1784184831.778110:0:6597:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1784184831.830014:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7812:x1870853265447680:12345-0@lo:700: Request processed in 136544us (139375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184831.830034:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784184831.830252:0:7812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d0380 x1870853265447680/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784184847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184831.830268:0:7812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265447680:0@lo:700: 00000004:02000040:0.0:1784184831.901836:0:7812:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1784184831.909180:0:7812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265448576:0@lo:5: 00000100:00100000:2.0:1784184831.909244:0:7812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184831.909299:0:7812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87d57180 going to sleep for 11 seconds 00000100:00100000:3.0:1784184831.909373:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448576 00000100:00100000:3.0:1784184831.909380:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448576 00000100:00100000:3.0:1784184831.909434:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784184831.909444:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7812:x1870853265448576:12345-0@lo:5: 00002000:00080000:3.0:1784184831.914734:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784184831.914877:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784184831.918896:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7812:x1870853265448576:12345-0@lo:5: Request processed in 9448us (9646us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784184831.918911:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784184831.918990:0:7812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b5180 x1870853265448576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784184847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184831.919008:0:7812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7812:1870853265448576:0@lo:5: 00000004:00080000:2.0:1784184831.919028:0:7812:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1784184832.522646:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784184832.775406:0:7986:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1784184833.227450:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184833.235874:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265448704:0@lo:13: 00000100:00100000:1.0:1784184833.235955:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184833.236183:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448704 00000100:00100000:2.0:1784184833.236192:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448704 00000100:00100000:2.0:1784184833.236263:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784184833.236273:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265448704:12345-0@lo:13: 00002000:00000024:2.0:1784184833.236310:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184833.236395:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265448704:12345-0@lo:13: Request processed in 122us (438us total) trans 0 rc 0/0 00000100:00080000:0.0:1784184833.236399:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784184833.236403:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1784184833.237010:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b5880 x1870853265448704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184833.237031:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265448704:0@lo:13: 00000100:00100000:1.0:1784184833.484748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184833.484857:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239210112 00000100:00100000:2.0:1784184833.484866:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239210112 00000100:00100000:2.0:1784184833.484913:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:2.0:1784184833.484921:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1870853239210112:12345-192.168.201.29@tcp:250: 00010000:00080000:2.0:1784184833.484948:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 5fe70326-3f31-45ab-b972-c3f25a334a81@192.168.201.29@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1784184833.484993:0:5784:0:(genops.c:1406:class_connect()) connect: client 5fe70326-3f31-45ab-b972-c3f25a334a81, cookie 0x63160f6fbe8aff51 00000100:00080000:2.0:1784184833.485132:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7419800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784184833.485204:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+5:2352:x1870853239210112:12345-192.168.201.29@tcp:250: Request processed in 282us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184833.485212:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:3.0:1784184833.489596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184833.489922:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239210240 00000100:00100000:0.0:1784184833.489931:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239210240 00000100:00100000:0.0:1784184833.490004:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:0.0:1784184833.490014:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+5:5559:x1870853239210240:12345-192.168.201.29@tcp:101: 00010000:00010000:0.0:1784184833.490031:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184833.490050:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d06 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184833.490076:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184833.490086:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184833.490095:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d800, rc 0) 00000100:00100000:0.0:1784184833.490155:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+6:5559:x1870853239210240:12345-192.168.201.29@tcp:101: Request processed in 142us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184833.490161:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:3.0:1784184833.492537:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184833.493553:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239210368 00000100:00100000:1.0:1784184833.493565:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239210368 00000100:00100000:1.0:1784184833.493621:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:1.0:1784184833.493645:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+6:5559:x1870853239210368:12345-192.168.201.29@tcp:501: 00000100:00100000:1.0:1784184833.494014:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+6:5559:x1870853239210368:12345-192.168.201.29@tcp:501: Request processed in 375us (1483us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784184833.494022:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:1.0:1784184833.511570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184833.511683:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239210496 00000100:00100000:2.0:1784184833.511694:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239210496 00000100:00100000:2.0:1784184833.511764:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:2.0:1784184833.511775:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+6:5559:x1870853239210496:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1784184833.511792:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184833.511810:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d0d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184833.511849:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184833.511861:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184833.511871:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971200, rc 0) 00000100:00100000:2.0:1784184833.511927:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+7:5559:x1870853239210496:12345-192.168.201.29@tcp:101: Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184833.511934:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:3.0:1784184833.515426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184833.515462:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239210624 00000100:00100000:3.0:1784184833.515473:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239210624 00000100:00100000:3.0:1784184833.515521:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1784184833.515531:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+7:5559:x1870853239210624:12345-192.168.201.29@tcp:501: 00000100:00100000:3.0:1784184833.515746:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5559:x1870853239210624:12345-192.168.201.29@tcp:501: Request processed in 216us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184833.515755:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:1.0:1784184833.523032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184833.523068:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239210752 00000100:00100000:1.0:1784184833.523077:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239210752 00000100:00100000:1.0:1784184833.523125:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:1.0:1784184833.523133:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5559:x1870853239210752:12345-192.168.201.29@tcp:503: 00000100:00100000:1.0:1784184833.523498:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5559:x1870853239210752:12345-192.168.201.29@tcp:503: Request processed in 364us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184833.523506:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:1.0:1784184833.538374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184833.538439:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239210880 00000100:00100000:3.0:1784184833.538449:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239210880 00000100:00100000:3.0:1784184833.538503:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:3.0:1784184833.538514:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5577:x1870853239210880:12345-192.168.201.29@tcp:502: 00000100:00100000:3.0:1784184833.539078:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5577:x1870853239210880:12345-192.168.201.29@tcp:502: Request processed in 563us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184833.539087:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00010000:00010000:3.0:1784184833.546563:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184833.593363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184833.593398:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211008 00000100:00100000:3.0:1784184833.593409:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211008 00000100:00100000:3.0:1784184833.594141:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1784184833.594154:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5577:x1870853239211008:12345-192.168.201.29@tcp:502: 00000100:00100000:3.0:1784184833.594432:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5577:x1870853239211008:12345-192.168.201.29@tcp:502: Request processed in 280us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184833.594456:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1784184833.600192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184833.600934:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211136 00000100:00100000:2.0:1784184833.600944:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211136 00000100:00100000:2.0:1784184833.601010:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:2.0:1784184833.601019:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5559:x1870853239211136:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1784184833.601035:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184833.601053:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971400/0x63160f6fbe8aff66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d37 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184833.601078:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971400/0x63160f6fbe8aff66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d37 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184833.601089:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971400/0x63160f6fbe8aff66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d37 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184833.601097:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971400, rc 0) 00000100:00100000:2.0:1784184833.601155:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5559:x1870853239211136:12345-192.168.201.29@tcp:101: Request processed in 136us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184833.601178:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:1.0:1784184833.613636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184833.614530:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211264 00000100:00100000:2.0:1784184833.614543:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211264 00000100:00100000:2.0:1784184833.614596:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:2.0:1784184833.614607:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5559:x1870853239211264:12345-192.168.201.29@tcp:256: 20000000:01000000:2.0:1784184833.614632:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784184833.614651:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784184833.614655:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784184833.614658:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784184833.614660:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1784184833.618770:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5559:x1870853239211264:12345-192.168.201.29@tcp:256: Request processed in 4154us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184833.618802:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:2.0:1784184833.624974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184833.625076:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211392 00000100:00100000:1.0:1784184833.625087:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211392 00000100:00100000:1.0:1784184833.625141:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:1.0:1784184833.625151:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5559:x1870853239211392:12345-192.168.201.29@tcp:101: 00010000:00010000:1.0:1784184833.625167:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184833.625182:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d3e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184833.625208:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184833.625220:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184833.625229:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f80031800, rc 0) 00000100:00100000:1.0:1784184833.625284:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5559:x1870853239211392:12345-192.168.201.29@tcp:101: Request processed in 135us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184833.625291:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:1.0:1784184833.629740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184833.629819:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211520 00000100:00100000:3.0:1784184833.629830:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211520 00000100:00100000:3.0:1784184833.629884:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:3.0:1784184833.629893:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5559:x1870853239211520:12345-192.168.201.29@tcp:501: 00000100:00100000:3.0:1784184833.630176:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5559:x1870853239211520:12345-192.168.201.29@tcp:501: Request processed in 283us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184833.630184:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:3.0:1784184833.637226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184833.637308:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211648 00000100:00100000:2.0:1784184833.637319:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211648 00000100:00100000:2.0:1784184833.637408:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:2.0:1784184833.637417:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5559:x1870853239211648:12345-192.168.201.29@tcp:503: 00000100:00100000:2.0:1784184833.637806:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5559:x1870853239211648:12345-192.168.201.29@tcp:503: Request processed in 388us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184833.637815:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:0.0:1784184833.646318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184833.646770:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211776 00000100:00100000:1.0:1784184833.646779:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211776 00000100:00100000:1.0:1784184833.646937:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:1.0:1784184833.646949:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5583:x1870853239211776:12345-192.168.201.29@tcp:502: 00000100:00100000:1.0:1784184833.647447:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5583:x1870853239211776:12345-192.168.201.29@tcp:502: Request processed in 499us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184833.647456:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:1.0:1784184833.654293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184833.654390:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239211904 00000100:00100000:3.0:1784184833.654401:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239211904 00000100:00100000:3.0:1784184833.654512:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:3.0:1784184833.654523:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5583:x1870853239211904:12345-192.168.201.29@tcp:502: 00000100:00100000:3.0:1784184833.654791:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5583:x1870853239211904:12345-192.168.201.29@tcp:502: Request processed in 263us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184833.654800:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:3.0:1784184833.663206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184833.663300:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212032 00000100:00100000:0.0:1784184833.663309:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212032 00000100:00100000:0.0:1784184833.663382:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1784184833.663388:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1870853239212032:12345-192.168.201.29@tcp:38: 00010000:00080000:0.0:1784184833.663416:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1784184833.663466:0:5792:0:(genops.c:1406:class_connect()) connect: client 89741aef-63f5-4e1f-9ce7-defb19b62903, cookie 0x63160f6fbe8aff74 00000004:00100000:0.0:1784184833.663493:0:5792:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1784184833.663498:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1784184833.739845:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7419000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784184833.740089:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2352:x1870853239212032:12345-192.168.201.29@tcp:38: Request processed in 76697us (76888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184833.740100:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00010000:00010000:3.0:1784184834.573002:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184834.758607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184834.758684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184834.758824:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212160 00000100:00100000:3.0:1784184834.758834:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212160 00000100:00100000:3.0:1784184834.758904:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212288 00000100:00100000:3.0:1784184834.758908:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212288 00000100:00100000:3.0:1784184834.758927:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1784184834.758937:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:0:x1870853239212160:12345-192.168.201.29@tcp:41: 00000004:00000024:3.0:1784184834.758984:0:7503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784184834.759062:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:0:x1870853239212160:12345-192.168.201.29@tcp:41: Request processed in 113us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184834.759078:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1784184834.759095:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1784184834.759102:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5559:x1870853239212288:12345-192.168.201.29@tcp:41: 00000004:00000024:3.0:1784184834.759114:0:7503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784184834.759136:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5559:x1870853239212288:12345-192.168.201.29@tcp:41: Request processed in 34us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184834.759142:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:0.0:1784184834.759706:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184834.777074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184834.777476:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212416 00000100:00100000:3.0:1784184834.777616:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212416 00000100:00100000:3.0:1784184834.777822:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1784184834.777834:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5559:x1870853239212416:12345-192.168.201.29@tcp:40: 00000100:00100000:3.0:1784184834.777957:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5559:x1870853239212416:12345-192.168.201.29@tcp:40: Request processed in 125us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184834.777965:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1784184834.793018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184834.793077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184834.793112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184834.793164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184834.793860:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212800 00000100:00100000:2.0:1784184834.793875:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212800 00000100:00100000:2.0:1784184834.793956:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1784184834.793969:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5559:x1870853239212800:12345-192.168.201.29@tcp:33: 00000100:00100000:1.0:1784184834.796076:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212544 00000100:00100000:1.0:1784184834.796096:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212544 00000100:00100000:1.0:1784184834.796154:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212672 00000100:00100000:1.0:1784184834.796158:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212672 00000100:00100000:1.0:1784184834.796178:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1784184834.796190:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239212544:12345-192.168.201.29@tcp:8: 00010000:00080000:1.0:1784184834.796555:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1784184834.796608:0:6589:0:(genops.c:1406:class_connect()) connect: client 89741aef-63f5-4e1f-9ce7-defb19b62903, cookie 0x63160f6fbe8aff7b 00002000:00100000:1.0:1784184834.796628:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 89741aef-63f5-4e1f-9ce7-defb19b62903/ffff9b5fb74a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784184834.796807:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1784184834.797510:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239212928 00000100:00100000:0.0:1784184834.797520:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239212928 00000100:00100000:0.0:1784184834.797581:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:0.0:1784184834.797590:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239212928:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1784184834.797939:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239212928:12345-192.168.201.29@tcp:400: Request processed in 349us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184834.797949:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00002000:00080000:1.0:1784184834.801113:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784184834.801173:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784184834.805473:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2352:x1870853239212544:12345-192.168.201.29@tcp:8: Request processed in 9257us (12445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184834.805508:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1784184834.805567:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1784184834.805598:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239212672:12345-192.168.201.29@tcp:8: 00010000:00080000:1.0:1784184834.805645:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1784184834.805709:0:6589:0:(genops.c:1406:class_connect()) connect: client 89741aef-63f5-4e1f-9ce7-defb19b62903, cookie 0x63160f6fbe8aff82 00002000:00100000:1.0:1784184834.805727:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 89741aef-63f5-4e1f-9ce7-defb19b62903/ffff9b5faec53800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784184834.805760:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784184834.806203:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784184834.806266:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5faec56800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784184834.806393:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2352:x1870853239212672:12345-192.168.201.29@tcp:8: Request processed in 794us (13323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184834.806401:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000004:00080000:2.0:1784184834.836414:0:5795:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42313us 00000004:00200000:3.0:1784184834.896143:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784184834.896390:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5559:x1870853239212800:12345-192.168.201.29@tcp:33: Request processed in 102415us (103267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184834.896408:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1784184835.255433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184835.255836:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213056 00000100:00100000:2.0:1784184835.255850:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213056 00000100:00100000:2.0:1784184835.255940:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1784184835.255953:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5600:x1870853239213056:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1784184835.255982:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184835.257535:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8aff89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186d68 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184835.257624:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8aff90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184835.257639:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8aff90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184835.257655:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8aff90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184835.257937:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784184835.257942:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184835.258018:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8aff90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184835.258048:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8aff89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d68 expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184835.258064:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8aff90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d68 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184835.258086:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184835.258089:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784184835.258093:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971800, rc 0) 00000100:00100000:2.0:1784184835.258258:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:5600:x1870853239213056:12345-192.168.201.29@tcp:101: Request processed in 2306us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184835.258268:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:1.0:1784184835.595596:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184836.618643:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184836.810645:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265448832:0@lo:13: 00000100:00100000:1.0:1784184836.810751:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184836.810879:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448832 00000100:00100000:2.0:1784184836.810887:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448832 00000100:00100000:2.0:1784184836.810955:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784184836.810966:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265448832:12345-0@lo:13: 00002000:00000024:2.0:1784184836.811002:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184836.811048:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265448832:12345-0@lo:13: Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184836.811056:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1784184836.811143:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b4a80 x1870853265448832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184836.811155:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784184836.811174:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265448832:0@lo:13: 00000100:00080000:3.0:1784184836.811235:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784184836.811503:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265449216:0@lo:400: 00000100:00100000:1.0:1784184836.811533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184836.811560:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184836.811566:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265449344:0@lo:400: 00000100:00100000:1.0:1784184836.811589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184836.811664:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265448960:0@lo:400: 00000100:00100000:3.0:1784184836.811698:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184836.811731:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265449472:0@lo:400: 00000100:00100000:3.0:1784184836.811753:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184836.811771:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784184836.811790:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265449088:0@lo:400: 00000100:00100000:3.0:1784184836.811813:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184836.811839:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449344 00000100:00100000:3.0:1784184836.811843:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449344 00000100:00100000:3.0:1784184836.811875:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784184836.811883:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265449344:12345-0@lo:400: 00000100:00100000:3.0:1784184836.811919:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265449344:12345-0@lo:400: Request processed in 37us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184836.811926:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1784184836.811943:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784184836.811952:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449216 00000100:00100000:3.0:1784184836.811955:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449216 00000100:00100000:3.0:1784184836.811979:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449472 00000100:00100000:3.0:1784184836.811982:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449472 00000100:00100000:3.0:1784184836.811994:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449088 00000100:00100000:3.0:1784184836.811997:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449088 00000100:00100000:3.0:1784184836.812008:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784184836.812014:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265449216:12345-0@lo:400: 00000100:00100000:3.0:1784184836.812043:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265449216:12345-0@lo:400: Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184836.812049:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784184836.812059:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784184836.812065:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265449472:12345-0@lo:400: 00000100:00100000:3.0:1784184836.812094:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265449472:12345-0@lo:400: Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184836.812099:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784184836.812110:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784184836.812116:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265449088:12345-0@lo:400: 00000100:00100000:3.0:1784184836.812149:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265449088:12345-0@lo:400: Request processed in 33us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184836.812155:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1784184836.812168:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784184836.812188:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b5880 x1870853265449344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184836.812200:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265449344:0@lo:400: 00000100:00100000:3.0:1784184836.812211:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265449216:0@lo:400: 00000100:00100000:3.0:1784184836.812235:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265449088:0@lo:400: 00000100:00100000:3.0:1784184836.812244:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265449472:0@lo:400: 00000100:00100000:1.0:1784184836.812319:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265448960 00000100:00100000:1.0:1784184836.812323:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265448960 00000100:00100000:1.0:1784184836.812382:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784184836.812396:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265448960:12345-0@lo:400: 00000100:00100000:1.0:1784184836.812429:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265448960:12345-0@lo:400: Request processed in 35us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184836.812436:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784184836.812606:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265448960:0@lo:400: 00000100:00100000:1.0:1784184837.415410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184837.415502:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213184 00000100:00100000:3.0:1784184837.415512:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213184 00000100:00100000:3.0:1784184837.415598:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784184837.415609:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:5652:x1870853239213184:12345-192.168.201.29@tcp:41: 00000004:00000024:3.0:1784184837.415671:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784184837.415748:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:5652:x1870853239213184:12345-192.168.201.29@tcp:41: Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184837.415756:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:0.0:1784184837.415830:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184837.422101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184837.422212:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213312 00000100:00100000:2.0:1784184837.422223:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213312 00000100:00100000:2.0:1784184837.422306:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1784184837.422317:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5652:x1870853239213312:12345-192.168.201.29@tcp:13: 00002000:00000024:2.0:1784184837.422388:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184837.422460:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5652:x1870853239213312:12345-192.168.201.29@tcp:13: Request processed in 144us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184837.422467:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:0.0:1784184837.422574:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784184837.431869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184837.432019:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213440 00000100:00100000:3.0:1784184837.432028:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213440 00000100:00100000:3.0:1784184837.432107:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1784184837.432119:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5652:x1870853239213440:12345-192.168.201.29@tcp:13: 00002000:00000024:3.0:1784184837.432145:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184837.432232:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:89741aef-63f5-4e1f-9ce7-defb19b62903+6:5652:x1870853239213440:12345-192.168.201.29@tcp:13: Request processed in 115us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184837.432239:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00080000:0.0:1784184837.432410:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784184837.642776:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184838.348908:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265449600:0@lo:13: 00000100:00100000:0.0:1784184838.348991:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184838.349126:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449600 00000100:00100000:1.0:1784184838.349135:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449600 00000100:00100000:1.0:1784184838.349206:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784184838.349216:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265449600:12345-0@lo:13: 00002000:00000024:1.0:1784184838.349241:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184838.349304:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265449600:12345-0@lo:13: Request processed in 89us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184838.349310:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1784184838.349384:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b6d80 x1870853265449600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184838.349517:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265449600:0@lo:13: 00000100:00080000:0.0:1784184838.349589:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784184838.666681:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784184838.929771:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000001:00100000:3.0:1784184838.955121:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00010000:00010000:3.0:1784184839.690824:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784184839.986864:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000100:00100000:3.0:1784184840.269927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184840.270119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184840.270160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184840.270192:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213824 00000100:00100000:3.0:1784184840.270196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184840.270201:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213824 00000100:00100000:3.0:1784184840.270231:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213952 00000100:00100000:3.0:1784184840.270235:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213952 00000100:00100000:2.0:1784184840.270303:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213696 00000100:00100000:2.0:1784184840.270307:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213696 00000100:00100000:2.0:1784184840.270405:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1784184840.270415:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239213696:12345-192.168.201.29@tcp:400: 00000100:00100000:2.0:1784184840.270489:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239213696:12345-192.168.201.29@tcp:400: Request processed in 75us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184840.270497:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:1.0:1784184840.270771:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1784184840.270780:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239213824:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1784184840.270816:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239213824:12345-192.168.201.29@tcp:400: Request processed in 38us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184840.270823:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1784184840.270845:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1784184840.270851:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239213952:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1784184840.270877:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239213952:12345-192.168.201.29@tcp:400: Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184840.270883:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1784184840.271001:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239213568 00000100:00100000:0.0:1784184840.271006:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239213568 00000100:00100000:0.0:1784184840.271037:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:0.0:1784184840.271044:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239213568:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1784184840.271081:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239213568:12345-192.168.201.29@tcp:400: Request processed in 37us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184840.271087:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00080000:0.0:1784184840.271120:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784184840.271124:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784184840.271126:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784184840.717277:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784184840.949748:0:8159:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784184841.738817:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184841.931061:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265449728:0@lo:13: 00000100:00100000:1.0:1784184841.931175:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184841.931249:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265450240:0@lo:400: 00000100:00100000:1.0:1784184841.931279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184841.931317:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784184841.931323:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265449856:0@lo:400: 00000100:00100000:1.0:1784184841.931384:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184841.931411:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265450368:0@lo:400: 00000100:00100000:1.0:1784184841.931439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184841.931474:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265450112:0@lo:400: 00000100:00100000:1.0:1784184841.931499:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184841.931517:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784184841.931522:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265449984:0@lo:400: 00000100:00100000:1.0:1784184841.931543:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184841.931558:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265450496:0@lo:400: 00000100:00100000:1.0:1784184841.931590:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184841.931622:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265450240 00000100:00100000:1.0:1784184841.931632:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265450240 00000100:00100000:1.0:1784184841.931703:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265450496 00000100:00100000:1.0:1784184841.931706:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265450496 00000100:00100000:1.0:1784184841.931751:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784184841.931760:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265450240:12345-0@lo:400: 00000100:00100000:1.0:1784184841.931821:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265450240:12345-0@lo:400: Request processed in 61us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184841.931841:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784184841.931863:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784184841.931869:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265450496:12345-0@lo:400: 00000100:00100000:1.0:1784184841.931903:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265450496:12345-0@lo:400: Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184841.931909:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784184841.931928:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449856 00000100:00100000:1.0:1784184841.931932:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449856 00000100:00100000:1.0:1784184841.931957:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784184841.931964:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265449856:12345-0@lo:400: 00000100:00100000:1.0:1784184841.931993:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265449856:12345-0@lo:400: Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184841.931999:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784184841.932029:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265450368 00000100:00100000:1.0:1784184841.932033:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265450368 00000100:00100000:1.0:1784184841.932058:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265450112 00000100:00100000:1.0:1784184841.932061:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265450112 00000100:00100000:1.0:1784184841.932074:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449984 00000100:00100000:1.0:1784184841.932076:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449984 00000100:00100000:1.0:1784184841.932088:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784184841.932094:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265450368:12345-0@lo:400: 00000100:00100000:1.0:1784184841.932123:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265450368:12345-0@lo:400: Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184841.932130:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784184841.932150:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184841.932155:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265450112:12345-0@lo:400: 00000100:00100000:1.0:1784184841.932184:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265450112:12345-0@lo:400: Request processed in 29us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184841.932190:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184841.932201:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784184841.932206:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265449984:12345-0@lo:400: 00000100:00100000:1.0:1784184841.932230:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265449984:12345-0@lo:400: Request processed in 24us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184841.932235:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1784184841.932255:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784184841.932261:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784184841.932264:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184841.932308:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265449984:0@lo:400: 00010000:00080000:1.0:1784184841.932325:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a6300 x1870853265450496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184841.932363:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265450496:0@lo:400: 00000100:00100000:1.0:1784184841.932376:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265450112:0@lo:400: 00000100:00100000:1.0:1784184841.932421:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265449856:0@lo:400: 00000100:00100000:1.0:1784184841.932432:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265450368:0@lo:400: 00010000:00080000:1.0:1784184841.932444:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb74a4a80 x1870853265450240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184841.932452:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265450240:0@lo:400: 00000100:00100000:0.0:1784184841.932953:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265449728 00000100:00100000:0.0:1784184841.932961:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265449728 00000100:00100000:0.0:1784184841.933000:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784184841.933007:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265449728:12345-0@lo:13: 00002000:00000024:0.0:1784184841.933046:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184841.933110:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265449728:12345-0@lo:13: Request processed in 103us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184841.933116:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1784184841.939270:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b6d80 x1870853265449728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184841.939359:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265449728:0@lo:13: 00010000:00010000:3.0:1784184842.763632:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184843.471456:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784184843.471489:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265450624:0@lo:13: 00000100:00100000:2.0:1784184843.471570:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184843.471637:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265450624 00000100:00100000:2.0:1784184843.471644:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265450624 00000100:00100000:2.0:1784184843.471712:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784184843.471722:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265450624:12345-0@lo:13: 00002000:00000024:2.0:1784184843.471757:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184843.471800:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265450624:12345-0@lo:13: Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184843.471807:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1784184843.471846:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b4700 x1870853265450624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184843.471865:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265450624:0@lo:13: 00000100:00080000:1.0:1784184843.474979:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784184843.798500:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184844.825720:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184845.393292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184845.393492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184845.393543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184845.393571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184845.393606:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214208 00000100:00100000:1.0:1784184845.393618:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214208 00000100:00100000:1.0:1784184845.393699:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1784184845.393711:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239214208:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1784184845.393807:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239214208:12345-192.168.201.29@tcp:400: Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.393816:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1784184845.393845:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214336 00000100:00100000:1.0:1784184845.393849:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214336 00000100:00100000:1.0:1784184845.393878:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214464 00000100:00100000:1.0:1784184845.393881:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214464 00000100:00100000:1.0:1784184845.393900:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1784184845.393906:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239214336:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1784184845.393934:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239214336:12345-192.168.201.29@tcp:400: Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.393941:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1784184845.393954:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1784184845.393960:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239214464:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1784184845.393995:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239214464:12345-192.168.201.29@tcp:400: Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.394001:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:1.0:1784184845.394321:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184845.394893:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214080 00000100:00100000:0.0:1784184845.394904:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214080 00000100:00100000:0.0:1784184845.394961:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:0.0:1784184845.394969:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239214080:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1784184845.395014:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239214080:12345-192.168.201.29@tcp:400: Request processed in 46us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184845.395021:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00080000:1.0:1784184845.396499:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784184845.396503:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1784184845.633052:0:8307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff69a95cd0 20000000:00000080:1.0:1784184845.633078:0:8307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b5fbf630400 uarg=0000000000000000 20000000:01000000:1.0:1784184845.633128:0:8307:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1784184845.633131:0:8307:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1784184845.633135:0:8307:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1784184845.633141:0:8307:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1784184845.633148:0:8307:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1784184845.633166:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784184845.633169:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784184845.633441:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784184845.633445:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784184845.647535:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1784184845.650391:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1784184845.650466:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1784184845.650534:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1784184845.650558:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1784184845.650562:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784184845.651769:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1784184845.652284:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1784184845.652608:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1784184845.652664:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1784184845.652683:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784184845.652686:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784184845.655939:0:8310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1784184845.656976:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1784184845.657060:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1784184845.657098:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1784184845.657118:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784184845.657121:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784184845.660771:0:8311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1784184845.664520:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1784184845.664598:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1784184845.664637:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1784184845.664665:0:8307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784184845.664692:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664716:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664739:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664747:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664755:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664763:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664770:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664777:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664790:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664797:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664807:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664873:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.664905:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 9 pid: 5787 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.664925:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265450752:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184845.665136:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665145:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 9 pid: 5786 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665155:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265450880:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184845.665190:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665212:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 18 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665224:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451008:0@lo:104: 00000100:00100000:0.0:1784184845.665277:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784184845.665324:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665518:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 18 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665529:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451136:0@lo:104: 00000100:00100000:0.0:1784184845.665559:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784184845.665656:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665665:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 18 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665673:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451264:0@lo:104: 00010000:00010000:0.0:1784184845.665702:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665710:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 18 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665717:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451392:0@lo:104: 00010000:00010000:0.0:1784184845.665743:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665751:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 18 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665759:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451520:0@lo:104: 00010000:00010000:0.0:1784184845.665782:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665788:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 18 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665796:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7123800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451648:0@lo:104: 00010000:00010000:0.0:1784184845.665817:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.665837:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 18 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.665846:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451776:0@lo:104: 00000100:00100000:0.0:1784184845.665866:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184845.666174:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784184845.666197:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184845.666220:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184845.666309:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184845.666322:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184845.666364:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184845.666377:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451008 00000100:00100000:3.0:1784184845.666386:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451008 00000100:00100000:3.0:1784184845.666435:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451136 00000100:00100000:3.0:1784184845.666439:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451136 00000100:00100000:3.0:1784184845.666451:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451264 00000100:00100000:3.0:1784184845.666453:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451264 00000100:00100000:3.0:1784184845.666462:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451392 00000100:00100000:3.0:1784184845.666465:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451392 00000100:00100000:3.0:1784184845.666472:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451520 00000100:00100000:3.0:1784184845.666474:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451520 00000100:00100000:3.0:1784184845.666482:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451648 00000100:00100000:3.0:1784184845.666485:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451648 00000100:00100000:3.0:1784184845.666493:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451776 00000100:00100000:3.0:1784184845.666496:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451776 00000100:00100000:3.0:1784184845.667675:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784184845.667702:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:8307:x1870853265451008:12345-0@lo:104: 00010000:00010000:3.0:1784184845.667726:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.667841:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784184845.667848:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+9:8307:x1870853265451008:12345-0@lo:104: Request processed in 159us (2572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184845.667857:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784184845.667895:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784184845.667903:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1778450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:8307:x1870853265451136:12345-0@lo:104: 00010000:00010000:3.0:1784184845.667929:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.667968:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784184845.667974:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1778450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+8:8307:x1870853265451136:12345-0@lo:104: Request processed in 72us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184845.667980:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784184845.668032:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784184845.668040:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+7:8307:x1870853265451264:12345-0@lo:104: 00010000:00010000:3.0:1784184845.668048:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668082:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784184845.668087:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+7:8307:x1870853265451264:12345-0@lo:104: Request processed in 49us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184845.668093:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784184845.668105:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784184845.668111:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:8307:x1870853265451392:12345-0@lo:104: 00010000:00010000:3.0:1784184845.668119:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668146:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784184845.668151:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+6:8307:x1870853265451392:12345-0@lo:104: Request processed in 41us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184845.668156:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784184845.668168:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784184845.668174:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:8307:x1870853265451520:12345-0@lo:104: 00010000:00010000:3.0:1784184845.668189:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668217:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784184845.668222:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:8307:x1870853265451520:12345-0@lo:104: Request processed in 49us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184845.668228:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784184845.668254:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784184845.668261:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:8307:x1870853265451648:12345-0@lo:104: 00010000:00010000:3.0:1784184845.668269:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668298:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1784184845.668302:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:8307:x1870853265451648:12345-0@lo:104: Request processed in 43us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184845.668307:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784184845.668319:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784184845.668324:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:8307:x1870853265451776:12345-0@lo:104: 00010000:00010000:3.0:1784184845.668357:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668383:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1784184845.668388:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:8307:x1870853265451776:12345-0@lo:104: Request processed in 64us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184845.668393:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1784184845.668419:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784184845.668426:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668441:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784184845.668445:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668454:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784184845.668462:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184845.668468:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784184845.668519:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668526:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784184845.668549:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668555:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8aff3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff43 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668571:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784184845.668574:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668579:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784184845.668581:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668597:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784184845.668603:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184845.668608:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784184845.668622:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668627:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784184845.668632:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668638:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8aff19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff20 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668648:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784184845.668651:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668656:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784184845.668659:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668665:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784184845.668671:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184845.668682:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784184845.668696:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668701:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784184845.668717:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668723:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8afefd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8aff04 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668732:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784184845.668735:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668740:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784184845.668743:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668749:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784184845.668755:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184845.668760:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784184845.668771:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668776:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784184845.668788:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668794:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8afeef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afef6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668804:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784184845.668806:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668812:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f800 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784184845.668815:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668828:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784184845.668835:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184845.668840:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784184845.668853:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668858:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784184845.668862:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668867:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f800/0x63160f6fbe8afee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afee8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668876:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784184845.668884:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668890:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784184845.668893:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668899:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784184845.668906:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184845.668911:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784184845.668925:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668931:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784184845.668935:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668940:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f93970600/0x63160f6fbe8afeb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afebe expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668950:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784184845.668953:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668959:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784184845.668961:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.668978:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784184845.668984:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184845.668990:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784184845.669002:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.669007:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784184845.669011:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.669017:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8afe8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe94 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184845.669031:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184845.669033:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184845.669034:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184845.669042:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184845.669389:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265452160:0@lo:103: 00000100:00100000:2.0:1784184845.669443:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184845.669490:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265452672:0@lo:103: 00000100:00100000:2.0:1784184845.669525:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184845.669554:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784184845.669560:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265452288:0@lo:103: 00000100:00100000:2.0:1784184845.669592:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184845.669661:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265450752:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184845.669674:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265450880:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184845.669684:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451008:0@lo:104: 00000100:00100000:2.0:1784184845.669695:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451136:0@lo:104: 00000100:00100000:2.0:1784184845.669705:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451264:0@lo:104: 00000100:00100000:2.0:1784184845.669714:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451392:0@lo:104: 00000100:00100000:2.0:1784184845.669722:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451520:0@lo:104: 00000100:00100000:2.0:1784184845.669731:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7123800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451648:0@lo:104: 00000100:00100000:2.0:1784184845.669738:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1870853265451776:0@lo:104: 00010000:00010000:2.0:1784184845.669807:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.669941:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452160 00000100:00100000:0.0:1784184845.669950:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452160 00010000:00010000:0.0:1784184845.669989:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 19 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.670023:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452672 00000100:00100000:0.0:1784184845.670026:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452672 00010000:00010000:0.0:1784184845.670037:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 20 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.670048:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452288 00000100:00100000:0.0:1784184845.670050:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452288 00010000:00010000:0.0:1784184845.670059:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 21 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184845.670073:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784184845.670082:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+21:3315:x1870853265452160:12345-0@lo:103: 00010000:00010000:0.0:1784184845.670097:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184845.670103:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 21 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670114:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 21 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670146:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971a00/0x63160f6fbe8aff04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afefd expref: 21 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670164:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184845.670207:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+20:3315:x1870853265452160:12345-0@lo:103: Request processed in 125us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184845.670214:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784184845.670234:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784184845.670241:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265452672:12345-0@lo:103: 00010000:00010000:0.0:1784184845.670249:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184845.670255:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 19 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670264:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 19 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670275:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8afe94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afe8d expref: 19 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670284:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184845.670306:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:3315:x1870853265452672:12345-0@lo:103: Request processed in 66us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184845.670312:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784184845.670323:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784184845.670328:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:3315:x1870853265452288:12345-0@lo:103: 00010000:00010000:0.0:1784184845.670354:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184845.670359:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 17 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670376:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 17 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670386:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896ec00/0x63160f6fbe8afef6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afeef expref: 17 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.670397:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184845.670419:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3315:x1870853265452288:12345-0@lo:103: Request processed in 90us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184845.670425:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784184845.670457:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265452288:0@lo:103: 00000100:00100000:0.0:1784184845.670467:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265452160:0@lo:103: 00000100:00100000:0.0:1784184845.670474:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265452672:0@lo:103: 00000100:00100000:0.0:1784184845.675425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184845.675474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184845.675631:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265451904:0@lo:103: 00000100:00100000:1.0:1784184845.675698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184845.675747:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265452416:0@lo:103: 00000100:00100000:1.0:1784184845.675774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184845.675797:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784184845.675804:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265452032:0@lo:103: 00000100:00100000:1.0:1784184845.675826:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184845.675837:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265452544:0@lo:103: 00000100:00100000:1.0:1784184845.675854:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184845.675917:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214720 00000100:00100000:1.0:1784184845.675927:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214720 00010000:00010000:1.0:1784184845.675975:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 10 pid: 5786 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184845.676004:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214592 00000100:00100000:1.0:1784184845.676006:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214592 00010000:00010000:1.0:1784184845.676018:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 11 pid: 5787 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184845.676029:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265451904 00000100:00100000:1.0:1784184845.676031:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265451904 00010000:00010000:1.0:1784184845.676045:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 16 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184845.676053:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452416 00000100:00100000:1.0:1784184845.676055:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452416 00010000:00010000:1.0:1784184845.676066:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 17 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184845.676074:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452032 00000100:00100000:1.0:1784184845.676076:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452032 00010000:00010000:1.0:1784184845.676084:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 18 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184845.676093:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452544 00000100:00100000:1.0:1784184845.676095:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452544 00010000:00010000:1.0:1784184845.676106:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 19 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184845.676120:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1784184845.676129:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:2355:x1870853239214720:12345-192.168.201.29@tcp:103: 00010000:00010000:1.0:1784184845.676157:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184845.676164:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 11 pid: 5786 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676177:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 11 pid: 5786 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676202:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8aff58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d06 expref: 11 pid: 5786 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676222:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184845.676277:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2355:x1870853239214720:12345-192.168.201.29@tcp:103: Request processed in 147us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.676286:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1784184845.676308:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784184845.676314:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+9:2355:x1870853239214592:12345-192.168.201.29@tcp:103: 00010000:00010000:1.0:1784184845.676322:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184845.676326:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 9 pid: 5787 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676367:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 9 pid: 5787 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676379:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8aff5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d0d expref: 9 pid: 5787 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676389:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184845.676408:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+8:2355:x1870853239214592:12345-192.168.201.29@tcp:103: Request processed in 94us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.676421:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784184845.676435:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784184845.676441:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265451904:12345-0@lo:103: 00010000:00010000:1.0:1784184845.676450:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184845.676455:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 19 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676464:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 19 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676474:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8aff43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8aff3c expref: 19 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676483:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184845.676529:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:3313:x1870853265451904:12345-0@lo:103: Request processed in 88us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.676535:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784184845.676547:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784184845.676552:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:3313:x1870853265452416:12345-0@lo:103: 00010000:00010000:1.0:1784184845.676559:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184845.676563:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 17 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676570:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 17 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676579:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896ee00/0x63160f6fbe8afee8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afee1 expref: 17 pid: 5784 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676601:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184845.676622:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3313:x1870853265452416:12345-0@lo:103: Request processed in 70us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.676628:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784184845.676667:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784184845.676673:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:3313:x1870853265452032:12345-0@lo:103: 00010000:00010000:1.0:1784184845.676680:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184845.676684:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 15 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676691:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 15 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676701:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8aff20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8aff19 expref: 15 pid: 5786 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676709:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184845.676728:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:3313:x1870853265452032:12345-0@lo:103: Request processed in 55us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184845.676734:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784184845.676744:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784184845.676749:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:3313:x1870853265452544:12345-0@lo:103: 00010000:00010000:1.0:1784184845.676755:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184845.676759:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 13 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676767:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 13 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676783:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896fa00/0x63160f6fbe8afebe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afeb7 expref: 13 pid: 5787 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676796:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676806:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676821:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676828:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676835:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676843:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676850:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631cc00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784184845.676855:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.676863:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184845.677377:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184845.680480:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265452032:0@lo:103: 00000100:00100000:0.0:1784184845.680504:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265451904:0@lo:103: 00000100:00100000:0.0:1784184845.680521:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265452416:0@lo:103: 00010000:00010000:2.0:1784184845.687826:0:8307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184845.687845:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.689590:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.689628:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8aff97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184845.689651:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184845.690392:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3313:x1870853265452544:12345-0@lo:103: Request processed in 13630us (14524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184845.690410:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784184845.690437:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265452544:0@lo:103: 00010000:00010000:3.0:1784184845.834586:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184846.859482:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184847.050657:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265452928:0@lo:400: 00000100:00100000:0.0:1784184847.050739:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.050760:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265452800:0@lo:400: 00000100:00100000:1.0:1784184847.050798:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.050825:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265453312:0@lo:400: 00000100:00100000:0.0:1784184847.050826:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265453440:0@lo:400: 00000100:00100000:1.0:1784184847.050848:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.050848:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.050872:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184847.050872:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784184847.050878:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265453184:0@lo:400: 00000100:00100000:0.0:1784184847.050878:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265453056:0@lo:400: 00000100:00100000:1.0:1784184847.050898:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.050898:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.050913:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265453568:0@lo:13: 00000100:00100000:1.0:1784184847.050929:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452800 00000100:00100000:0.0:1784184847.050933:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.050936:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452800 00000100:00100000:0.0:1784184847.050981:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265452928 00000100:00100000:1.0:1784184847.050982:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784184847.050984:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265452928 00000100:00100000:1.0:1784184847.050990:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3316:x1870853265452800:12345-0@lo:400: 00000100:00100000:0.0:1784184847.051008:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453312 00000100:00100000:0.0:1784184847.051010:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453312 00000100:00100000:0.0:1784184847.051029:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453056 00000100:00100000:0.0:1784184847.051031:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453056 00000100:00100000:1.0:1784184847.051036:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:3316:x1870853265452800:12345-0@lo:400: Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184847.051044:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784184847.051045:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784184847.051050:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265452928:12345-0@lo:400: 00000100:00100000:1.0:1784184847.051077:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784184847.051084:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265453312:12345-0@lo:400: 00000100:00100000:0.0:1784184847.051084:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265452928:12345-0@lo:400: Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184847.051090:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784184847.051103:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784184847.051108:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265453056:12345-0@lo:400: 00000100:00100000:1.0:1784184847.051109:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265453312:12345-0@lo:400: Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184847.051115:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784184847.051132:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453440 00000100:00100000:0.0:1784184847.051132:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265453056:12345-0@lo:400: Request processed in 24us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184847.051135:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453440 00000100:00100000:0.0:1784184847.051138:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784184847.051157:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453184 00000100:00100000:2.0:1784184847.051202:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453568 00000100:00100000:2.0:1784184847.051207:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453568 00000100:00100000:2.0:1784184847.051234:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784184847.051241:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265453568:12345-0@lo:13: 00002000:00000024:2.0:1784184847.051271:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184847.051313:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265453568:12345-0@lo:13: Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.051319:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784184847.051432:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453184 00000100:00080000:3.0:1784184847.051666:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784184847.051671:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784184847.051673:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184847.051726:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265453056:0@lo:400: 00010000:00080000:3.0:1784184847.051741:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b5880 x1870853265453568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184847.051769:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265453568:0@lo:13: 00000100:00100000:3.0:1784184847.051781:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265452928:0@lo:400: 00000100:00100000:3.0:1784184847.051831:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265452800:0@lo:400: 00000100:00100000:3.0:1784184847.051840:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265453312:0@lo:400: 00000100:00100000:0.0:1784184847.052528:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784184847.052758:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265453440:12345-0@lo:400: 00000100:00100000:0.0:1784184847.052838:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265453440:12345-0@lo:400: Request processed in 300us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184847.052855:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784184847.052874:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784184847.052881:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265453184:12345-0@lo:400: 00010000:00080000:3.0:1784184847.052941:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7122d80 x1870853265453440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184847.052964:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265453440:0@lo:400: 00000100:00100000:0.0:1784184847.053804:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265453184:12345-0@lo:400: Request processed in 909us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184847.053814:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1784184847.054227:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7121f80 x1870853265453184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184847.054240:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265453184:0@lo:400: 10000000:01000000:0.0:1784184847.562626:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784184847.562640:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fbfbf1800 from 39 10000000:01000000:0.0:1784184847.562647:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784184847.562720:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184847.562735:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184847.562750:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184847.562783:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265453696:0@lo:101: 00000100:00100000:0.0:1784184847.562877:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.563047:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8e180 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.568203:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453696 00000100:00100000:2.0:1784184847.568227:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453696 00000100:00100000:2.0:1784184847.568649:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784184847.568663:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+12:5789:x1870853265453696:12345-0@lo:101: 00010000:00010000:2.0:1784184847.568688:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184847.568721:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971000/0x63160f6fbe8affa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8aff9e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.568762:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971000/0x63160f6fbe8affa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8aff9e expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.568776:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971000/0x63160f6fbe8affa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8aff9e expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.568787:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971000, rc 0) 00000100:00100000:2.0:1784184847.568902:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265453696:12345-0@lo:101: Request processed in 243us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.568910:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784184847.569020:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265453696:0@lo:101: 00010000:00010000:3.0:1784184847.569056:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.569070:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184847.569162:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265453824:0@lo:501: 00000100:00100000:3.0:1784184847.569236:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.569287:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1000 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.569433:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453824 00000100:00100000:2.0:1784184847.569441:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453824 00000100:00100000:2.0:1784184847.569492:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784184847.569500:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265453824:12345-0@lo:501: 00000100:00100000:2.0:1784184847.569855:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265453824:12345-0@lo:501: Request processed in 355us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.569863:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784184847.569910:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265453824:0@lo:501: 00000100:00100000:3.0:1784184847.569949:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265453952:0@lo:503: 00000100:00100000:3.0:1784184847.570011:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.570058:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1000 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.570844:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265453952 00000100:00100000:2.0:1784184847.570865:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265453952 00000100:00100000:2.0:1784184847.570913:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784184847.570922:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265453952:12345-0@lo:503: 00000100:00100000:2.0:1784184847.571182:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265453952:12345-0@lo:503: Request processed in 260us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.571191:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784184847.571239:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265453952:0@lo:503: 00000100:00100000:1.0:1784184847.587560:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8323:1870853265454080:0@lo:502: 00000100:00100000:1.0:1784184847.587713:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.587763:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.587914:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454080 00000100:00100000:3.0:1784184847.587922:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454080 00000100:00100000:3.0:1784184847.587977:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784184847.587987:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:8323:x1870853265454080:12345-0@lo:502: 00000100:00100000:3.0:1784184847.588258:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:8323:x1870853265454080:12345-0@lo:502: Request processed in 272us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.588266:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784184847.588488:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8323:1870853265454080:0@lo:502: 00000100:00100000:1.0:1784184847.588538:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8323:1870853265454208:0@lo:502: 00000100:00100000:1.0:1784184847.588573:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.588652:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9840 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.596006:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454208 00000100:00100000:2.0:1784184847.596021:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454208 00000100:00100000:2.0:1784184847.596090:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784184847.596101:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:8323:x1870853265454208:12345-0@lo:502: 00000100:00100000:2.0:1784184847.596443:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:8323:x1870853265454208:12345-0@lo:502: Request processed in 343us (7868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.596451:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784184847.597028:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8323:1870853265454208:0@lo:502: 00000040:00080000:1.0:1784184847.597065:0:8323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784184847.598947:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784184847.598983:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784184847.598994:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184847.599007:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184847.599037:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1784184847.599040:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1784184847.599043:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784184847.599085:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184847.599093:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184847.599103:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184847.599125:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454336:0@lo:101: 00000100:00100000:0.0:1784184847.599186:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.599231:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8e900 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.599307:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454336 00000100:00100000:2.0:1784184847.599313:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454336 00000100:00100000:2.0:1784184847.599517:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784184847.599526:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+13:5789:x1870853265454336:12345-0@lo:101: 00010000:00010000:2.0:1784184847.599539:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184847.599550:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970400/0x63160f6fbe8affb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8affac expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.599572:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970400/0x63160f6fbe8affb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8affac expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.599582:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970400/0x63160f6fbe8affb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8affac expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.599590:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970400, rc 0) 00000100:00100000:2.0:1784184847.599631:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265454336:12345-0@lo:101: Request processed in 107us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.599644:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784184847.599718:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454336:0@lo:101: 00010000:00010000:0.0:1784184847.599732:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184847.599740:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184847.599786:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454464:0@lo:501: 00000100:00100000:0.0:1784184847.599813:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.602257:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8e900 going to sleep for 11 seconds 00000100:00100000:1.0:1784184847.602606:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454464 00000100:00100000:1.0:1784184847.602615:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454464 00000100:00100000:1.0:1784184847.602668:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784184847.602676:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265454464:12345-0@lo:501: 00000100:00100000:1.0:1784184847.603007:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265454464:12345-0@lo:501: Request processed in 330us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184847.603014:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784184847.603520:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454464:0@lo:501: 00000100:00100000:0.0:1784184847.603572:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454592:0@lo:503: 00000100:00100000:0.0:1784184847.603632:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.603771:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.603843:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454592 00000100:00100000:3.0:1784184847.603849:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454592 00000100:00100000:1.0:1784184847.603952:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784184847.603961:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265454592:12345-0@lo:503: 00000100:00100000:1.0:1784184847.604124:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265454592:12345-0@lo:503: Request processed in 164us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184847.604131:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784184847.604208:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454592:0@lo:503: 00000100:00100000:0.0:1784184847.605719:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8324:1870853265454720:0@lo:502: 00000100:00100000:0.0:1784184847.605794:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.605845:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.605954:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454720 00000100:00100000:2.0:1784184847.605961:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454720 00000100:00100000:2.0:1784184847.606004:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784184847.606013:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:8324:x1870853265454720:12345-0@lo:502: 00000100:00100000:2.0:1784184847.606203:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:8324:x1870853265454720:12345-0@lo:502: Request processed in 191us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.606209:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784184847.606544:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8324:1870853265454720:0@lo:502: 00000020:01000000:0.0:1784184847.606571:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784184847.606581:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184847.606584:0:8324:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784184847.606589:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784184847.606613:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8324:1870853265454848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184847.606646:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.606663:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.606945:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454848 00000100:00100000:2.0:1784184847.606950:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454848 00000100:00100000:2.0:1784184847.606985:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784184847.606991:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:8324:x1870853265454848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184847.607109:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:8324:x1870853265454848:12345-0@lo:502:llog_process_th.0 Request processed in 118us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.607115:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784184847.607187:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8324:1870853265454848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784184847.607203:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784184847.607207:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184847.607209:0:8324:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784184847.607212:0:8324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784184847.607400:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1784184847.607417:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784184847.607426:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.607436:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184847.607446:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784184847.607448:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fc0d20000 from 39 10000000:01000000:2.0:1784184847.607451:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784184847.607484:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.607500:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.607510:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184847.607526:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.607555:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184847.607577:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f84c6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.607589:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265454976 00000100:00100000:2.0:1784184847.607592:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265454976 00000100:00100000:2.0:1784184847.607612:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784184847.607617:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:5789:x1870853265454976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184847.607625:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184847.607635:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970600/0x63160f6fbe8affc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8affba expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.607654:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970600/0x63160f6fbe8affc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8affba expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.607664:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970600/0x63160f6fbe8affc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8affba expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.607672:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970600, rc 0) 00000100:00100000:2.0:1784184847.607697:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265454976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.607702:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784184847.607741:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265454976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184847.607753:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.607762:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184847.607799:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.607820:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184847.607832:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f84c6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.607916:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265455104 00000100:00100000:2.0:1784184847.607920:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265455104 00000100:00100000:2.0:1784184847.607939:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784184847.607944:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265455104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.608156:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265455104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.608162:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784184847.608190:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.608212:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.608239:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184847.608250:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.608259:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265455232 00000100:00100000:2.0:1784184847.608262:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265455232 00000100:00100000:2.0:1784184847.608278:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784184847.608283:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265455232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.608513:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265455232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.608525:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784184847.608557:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.609500:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8325:1870853265455360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.609545:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.609605:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.609639:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265455360 00000100:00100000:2.0:1784184847.609644:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265455360 00000100:00100000:2.0:1784184847.609699:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784184847.609707:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:8325:x1870853265455360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184847.609902:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:8325:x1870853265455360:12345-0@lo:502:llog_process_th.0 Request processed in 195us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.609909:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784184847.609977:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8325:1870853265455360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184847.610022:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8325:1870853265455488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184847.610053:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184847.610196:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.610259:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265455488 00000100:00100000:3.0:1784184847.610264:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265455488 00000100:00100000:3.0:1784184847.610286:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784184847.610291:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:8325:x1870853265455488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.610717:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:8325:x1870853265455488:12345-0@lo:502:llog_process_th.0 Request processed in 424us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.610725:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784184847.611013:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8325:1870853265455488:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784184847.611036:0:8325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784184847.611196:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784184847.611214:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784184847.611223:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.611234:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184847.611243:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784184847.611245:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784184847.611248:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784184847.611273:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.611281:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.611290:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184847.611313:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.611507:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184847.611538:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.611596:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265455616 00000100:00100000:3.0:1784184847.611601:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265455616 00000100:00100000:3.0:1784184847.611636:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784184847.611643:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:5789:x1870853265455616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184847.611662:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184847.611674:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a800/0x63160f6fbe8affcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8affc8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.611696:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a800/0x63160f6fbe8affcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8affc8 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.611707:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a800/0x63160f6fbe8affcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8affc8 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.611715:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a800, rc 0) 00000100:00100000:3.0:1784184847.611749:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265455616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.611755:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784184847.611787:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184847.611800:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.611808:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184847.611867:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.611893:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.611910:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.611921:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265455744 00000100:00100000:3.0:1784184847.611924:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265455744 00000100:00100000:3.0:1784184847.611941:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784184847.611946:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265455744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.612172:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265455744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.612178:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784184847.612204:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.612230:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.612263:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.612276:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.612286:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265455872 00000100:00100000:3.0:1784184847.612289:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265455872 00000100:00100000:3.0:1784184847.612307:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784184847.612313:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265455872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.612470:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265455872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.612487:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784184847.612526:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265455872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.612688:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8326:1870853265456000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.612720:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.612739:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456000 00000100:00100000:3.0:1784184847.612742:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456000 00000100:00100000:3.0:1784184847.612759:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784184847.612765:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:8326:x1870853265456000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.612878:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:8326:x1870853265456000:12345-0@lo:502:llog_process_th.0 Request processed in 111us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.612884:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784184847.612916:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1540 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.612929:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8326:1870853265456000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784184847.612950:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784184847.612958:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184847.612960:0:8326:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784184847.612964:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784184847.612984:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8326:1870853265456128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.613015:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.613034:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456128 00000100:00100000:3.0:1784184847.613037:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456128 00000100:00100000:3.0:1784184847.613054:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784184847.613059:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:8326:x1870853265456128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.613161:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:8326:x1870853265456128:12345-0@lo:502:llog_process_th.0 Request processed in 101us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.613167:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784184847.613195:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1540 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.613207:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8326:1870853265456128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784184847.613227:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784184847.613231:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184847.613232:0:8326:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784184847.613236:0:8326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1784184847.613279:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1784184847.613294:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784184847.613300:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.613308:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184847.613327:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784184847.613348:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5f85958000 from 39 10000000:01000000:3.0:1784184847.613350:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784184847.613369:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.613377:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.613384:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184847.613397:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.613421:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.613434:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f873529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.613444:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456256 00000100:00100000:3.0:1784184847.613448:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456256 00000100:00100000:3.0:1784184847.613464:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784184847.613469:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265456256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184847.613487:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184847.613496:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8affdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8affd6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.613512:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8affdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8affd6 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.613521:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8affdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8affd6 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.613538:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164ba00, rc 0) 00000100:00100000:3.0:1784184847.613567:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265456256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.613573:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784184847.613603:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184847.613615:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.613622:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184847.613656:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.613680:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.613692:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.613702:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456384 00000100:00100000:3.0:1784184847.613705:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456384 00000100:00100000:3.0:1784184847.613720:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784184847.613725:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265456384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.613887:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265456384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.613893:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784184847.613922:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.613947:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.613980:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.614000:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.614011:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456512 00000100:00100000:3.0:1784184847.614014:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456512 00000100:00100000:3.0:1784184847.614028:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784184847.614033:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265456512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.614144:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265456512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.614150:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784184847.614178:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.614351:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8327:1870853265456640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.614383:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.614400:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456640 00000100:00100000:3.0:1784184847.614404:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456640 00000100:00100000:3.0:1784184847.614420:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784184847.614425:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8327:x1870853265456640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184847.615045:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249540 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.615232:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8327:x1870853265456640:12345-0@lo:502:llog_process_th.0 Request processed in 805us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.615239:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784184847.615554:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8327:1870853265456640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.615680:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8327:1870853265456768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.615719:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.615785:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb92499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.615816:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456768 00000100:00100000:2.0:1784184847.615822:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456768 00000100:00100000:2.0:1784184847.616189:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784184847.616197:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8327:x1870853265456768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184847.616706:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8327:x1870853265456768:12345-0@lo:502:llog_process_th.0 Request processed in 508us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.616714:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784184847.617626:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8327:1870853265456768:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784184847.617676:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784184847.617941:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784184847.617961:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784184847.617971:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184847.617995:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184847.618005:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784184847.618008:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1784184847.618011:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784184847.618041:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184847.618049:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184847.618057:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184847.618076:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784184847.618118:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.618157:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.618248:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265456896 00000100:00100000:3.0:1784184847.618255:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265456896 00000100:00100000:3.0:1784184847.618300:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784184847.618308:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265456896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184847.618441:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184847.618455:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8affeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8affe4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.618489:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8affeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8affe4 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.618500:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8affeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8affe4 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.618509:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a200, rc 0) 00000100:00100000:3.0:1784184847.618553:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265456896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.618559:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784184847.618625:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265456896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784184847.618650:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184847.618659:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184847.618704:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184847.618728:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.618759:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.619004:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457024 00000100:00100000:3.0:1784184847.619008:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457024 00000100:00100000:3.0:1784184847.619039:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784184847.619046:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265457024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.619274:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265457024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.619281:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784184847.619372:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184847.619399:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184847.619439:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184847.619463:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184847.619489:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457152 00000100:00100000:1.0:1784184847.619493:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457152 00000100:00100000:1.0:1784184847.619512:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784184847.619518:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265457152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184847.619668:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265457152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184847.619675:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784184847.619711:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784184847.622667:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8328:1870853265457280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184847.622746:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184847.622811:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184847.622911:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457280 00000100:00100000:1.0:1784184847.622919:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457280 00000100:00100000:1.0:1784184847.622991:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784184847.623001:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8328:x1870853265457280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184847.623230:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8328:x1870853265457280:12345-0@lo:502:llog_process_th.0 Request processed in 231us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184847.623239:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784184847.623360:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8328:1870853265457280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784184847.623388:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784184847.623396:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184847.623399:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784184847.623404:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784184847.623425:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8328:1870853265457408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184847.623458:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184847.623703:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1784184847.623766:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457408 00000100:00100000:3.0:1784184847.623771:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457408 00000100:00100000:3.0:1784184847.623795:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784184847.623801:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8328:x1870853265457408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184847.624032:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8328:x1870853265457408:12345-0@lo:502:llog_process_th.0 Request processed in 231us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184847.624045:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784184847.624121:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8328:1870853265457408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784184847.624146:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184847.624150:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184847.624152:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784184847.624155:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784184847.624295:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1784184847.624315:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784184847.624487:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.624499:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784184847.624509:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784184847.624511:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b5f90580000 from 1 10000000:01000000:3.0:1784184847.624514:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784184847.624542:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.624550:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.624559:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184847.624575:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.624605:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.624619:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f9047d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184847.624659:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457536 00000100:00100000:2.0:1784184847.624662:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457536 00000100:00100000:2.0:1784184847.624682:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784184847.624687:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265457536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184847.624696:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184847.624709:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8afff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8afff2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.624729:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8afff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8afff2 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.624738:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8afff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afff2 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184847.624746:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970000, rc 0) 00000100:00100000:2.0:1784184847.624779:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265457536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184847.624785:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784184847.624907:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184847.624920:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afff9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.624940:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afff9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184847.624982:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184847.625005:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184847.625054:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f9047d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184847.625105:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457664 00000100:00100000:1.0:1784184847.625109:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457664 00000100:00100000:0.0:1784184847.625177:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784184847.625187:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265457664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784184847.625431:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265457664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (423us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784184847.625438:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784184847.625515:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265457664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784184847.625537:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784184847.625544:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afff9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184847.625550:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afff9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184847.882659:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184848.588439:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784184848.588489:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265457792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184848.588593:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184848.588927:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457792 00000100:00100000:2.0:1784184848.588939:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457792 00000100:00100000:2.0:1784184848.589013:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784184848.589024:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265457792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784184848.589071:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184848.589141:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265457792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184848.589168:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1784184848.589269:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b4700 x1870853265457792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184848.589302:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265457792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784184848.906693:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184849.932746:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184850.518527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184850.518568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184850.518598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184850.518630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184850.518659:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239215104 00000100:00100000:0.0:1784184850.518667:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239215104 00000100:00100000:0.0:1784184850.518718:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239215232 00000100:00100000:0.0:1784184850.518720:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239215232 00000100:00100000:0.0:1784184850.518735:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1784184850.518744:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239215104:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1784184850.518808:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239215104:12345-192.168.201.29@tcp:400: Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184850.518815:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1784184850.518829:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1784184850.518835:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239215232:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1784184850.518852:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239215232:12345-192.168.201.29@tcp:400: Request processed in 18us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184850.518870:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1784184850.519006:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214976 00000100:00100000:0.0:1784184850.519010:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214976 00000100:00100000:0.0:1784184850.519037:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1784184850.519042:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239214976:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1784184850.519071:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239214976:12345-192.168.201.29@tcp:400: Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184850.519077:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1784184850.519374:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239214848 00000100:00100000:1.0:1784184850.519385:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239214848 00000100:00100000:1.0:1784184850.519424:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:1.0:1784184850.519441:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+8:2356:x1870853239214848:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1784184850.519484:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+8:2356:x1870853239214848:12345-192.168.201.29@tcp:400: Request processed in 53us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184850.519491:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00080000:3.0:1784184850.520826:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784184850.520842:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784184850.520847:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784184850.954582:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184851.978679:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184852.050499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184852.050681:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239215360 00000100:00100000:2.0:1784184852.050696:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239215360 00000100:00100000:2.0:1784184852.050762:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:2.0:1784184852.050775:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+8:5573:x1870853239215360:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1784184852.050799:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184852.050824:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8b0000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d6f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184852.050861:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8b0000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d6f expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184852.050876:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8b0000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d6f expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184852.050887:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970e00, rc 0) 00000100:00100000:2.0:1784184852.050965:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5573:x1870853239215360:12345-192.168.201.29@tcp:101: Request processed in 192us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184852.050973:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:2.0:1784184852.060303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184852.065590:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239215488 00000100:00100000:0.0:1784184852.065605:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239215488 00000100:00100000:0.0:1784184852.065691:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:0.0:1784184852.065702:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5573:x1870853239215488:12345-192.168.201.29@tcp:501: 00000100:00100000:0.0:1784184852.066057:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5573:x1870853239215488:12345-192.168.201.29@tcp:501: Request processed in 356us (5762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184852.066067:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:0.0:1784184852.072512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184852.073395:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239215616 00000100:00100000:1.0:1784184852.073416:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239215616 00000100:00100000:1.0:1784184852.073486:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:1.0:1784184852.073495:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5573:x1870853239215616:12345-192.168.201.29@tcp:503: 00000100:00100000:1.0:1784184852.073927:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5573:x1870853239215616:12345-192.168.201.29@tcp:503: Request processed in 431us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184852.073934:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:1.0:1784184852.082569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184852.082970:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239215744 00000100:00100000:2.0:1784184852.082981:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239215744 00000100:00100000:2.0:1784184852.083043:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:2.0:1784184852.083053:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+9:6071:x1870853239215744:12345-192.168.201.29@tcp:502: 00000100:00100000:2.0:1784184852.084651:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+9:6071:x1870853239215744:12345-192.168.201.29@tcp:502: Request processed in 1594us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184852.084662:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:2.0:1784184852.100077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184852.100384:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239215872 00000100:00100000:0.0:1784184852.100394:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239215872 00000100:00100000:0.0:1784184852.100450:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:0.0:1784184852.100460:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+9:6071:x1870853239215872:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784184852.100791:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+9:6071:x1870853239215872:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 330us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184852.100800:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:0.0:1784184852.105098:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184852.105215:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216000 00000100:00100000:2.0:1784184852.105228:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216000 00000100:00100000:2.0:1784184852.105300:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:2.0:1784184852.105309:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5573:x1870853239216000:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184852.105326:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184852.105440:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970800/0x63160f6fbe8b0007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d76 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184852.105478:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970800/0x63160f6fbe8b0007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d76 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184852.105489:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970800/0x63160f6fbe8b0007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d76 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184852.105498:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970800, rc 0) 00000100:00100000:2.0:1784184852.105560:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216000:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 251us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184852.105566:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:2.0:1784184852.116491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184852.116903:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216128 00000100:00100000:1.0:1784184852.116914:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216128 00000100:00100000:1.0:1784184852.116980:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:1.0:1784184852.116990:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216128:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184852.117290:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216128:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 301us (810us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784184852.117299:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:3.0:1784184852.173028:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265458048:0@lo:400:kworker.0 00000100:00100000:3.0:1784184852.173110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184852.173169:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265458560:0@lo:400:kworker.0 00000100:00100000:3.0:1784184852.173196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184852.173227:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784184852.173233:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265458176:0@lo:400:kworker.0 00000100:00100000:3.0:1784184852.173269:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184852.173297:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265458560 00000100:00100000:3.0:1784184852.173305:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265458560 00000100:00100000:3.0:1784184852.173380:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784184852.173388:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265458560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184852.173576:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265458560:12345-0@lo:400:kworker.0 Request processed in 188us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184852.173584:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1784184852.173605:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784184852.173632:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d5c00 x1870853265458560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184852.173645:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265458560:0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.173896:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265457920:0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.173930:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184852.173954:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265458432:0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.173977:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184852.173995:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184852.173999:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265458304:0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.174031:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184852.174057:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265458048 00000100:00100000:0.0:1784184852.174061:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265458048 00000100:00100000:0.0:1784184852.174100:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265458176 00000100:00100000:0.0:1784184852.174104:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265458176 00000100:00100000:0.0:1784184852.174126:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265458432 00000100:00100000:0.0:1784184852.174129:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265458432 00000100:00100000:0.0:1784184852.174141:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784184852.174147:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265458048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.174179:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265458048:12345-0@lo:400:kworker.0 Request processed in 32us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184852.174185:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784184852.174197:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784184852.174202:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265458176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.174229:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265458176:12345-0@lo:400:kworker.0 Request processed in 27us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184852.174235:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784184852.174245:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784184852.174251:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265458432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.174279:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265458432:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184852.174294:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784184852.174324:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265458432:0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.174357:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265457920 00000100:00100000:0.0:1784184852.174361:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265457920 00000100:00100000:0.0:1784184852.174382:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784184852.174387:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265457920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184852.174431:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265457920:12345-0@lo:400:kworker.0 Request processed in 43us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184852.174436:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784184852.174468:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265457920:0@lo:400:kworker.0 00000100:00100000:2.0:1784184852.174956:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265458304 00000100:00100000:2.0:1784184852.174961:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265458304 00000100:00100000:2.0:1784184852.174999:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784184852.175006:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265458304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184852.175058:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265458304:12345-0@lo:400:kworker.0 Request processed in 53us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184852.175066:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1784184852.175108:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d5500 x1870853265458304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184852.175128:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265458304:0@lo:400:kworker.0 00000100:00080000:3.0:1784184852.175296:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784184852.175301:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184852.175323:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265458176:0@lo:400:kworker.0 00000100:00100000:3.0:1784184852.175355:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265458048:0@lo:400:kworker.0 00000100:00100000:3.0:1784184852.175369:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784184852.175376:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265458688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184852.175417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184852.176805:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265458688 00000100:00100000:2.0:1784184852.176815:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265458688 00000100:00100000:2.0:1784184852.176869:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784184852.176877:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265458688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184852.176909:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184852.176975:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265458688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184852.176981:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1784184852.177800:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b4a80 x1870853265458688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184852.177823:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265458688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784184853.008377:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784184853.427556:0:8368:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc19a01c0 20000000:00000080:2.0:1784184853.427577:0:8368:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b5fc139ec00 uarg=0000000000000000 20000000:01000000:2.0:1784184853.427614:0:8368:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784184853.427621:0:8368:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784184853.427626:0:8368:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784184853.428641:0:8369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1784184853.428803:0:8368:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1784184853.434822:0:8368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1784184853.434882:0:8368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1784184853.434939:0:8368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1784184853.434957:0:8368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784184853.434975:0:8368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.434994:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896f600/0x63160f6fbe8afdd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.435291:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.435312:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.435321:0:8368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.435354:0:8368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.435405:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.435420:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 9 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184853.435436:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265458816:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184853.436031:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436043:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 18 pid: 5787 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184853.436054:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265458944:0@lo:104: 00000100:00100000:2.0:1784184853.436095:0:8368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784184853.436133:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436142:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 18 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184853.436163:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265459072:0@lo:104: 00000100:00100000:2.0:1784184853.436189:0:8368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784184853.436215:0:8368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896f600/0x63160f6fbe8afdd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436224:0:8368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f9896f600/0x63160f6fbe8afdd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 18 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184853.436233:0:8368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265459200:0@lo:104: 00000100:00100000:2.0:1784184853.436249:0:8368:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fcc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184853.436421:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784184853.436441:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184853.436452:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265458944 00000100:00100000:2.0:1784184853.436458:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265458944 00000100:00100000:2.0:1784184853.436495:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459072 00000100:00100000:2.0:1784184853.436498:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459072 00000100:00100000:2.0:1784184853.436510:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459200 00000100:00100000:2.0:1784184853.436512:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459200 00000100:00100000:2.0:1784184853.436523:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784184853.436530:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:8368:x1870853265458944:12345-0@lo:104: 00010000:00010000:2.0:1784184853.436542:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436599:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784184853.436605:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:8368:x1870853265458944:12345-0@lo:104: Request processed in 75us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184853.436612:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784184853.436629:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784184853.436641:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:8368:x1870853265459072:12345-0@lo:104: 00010000:00010000:2.0:1784184853.436649:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436681:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784184853.436686:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:8368:x1870853265459072:12345-0@lo:104: Request processed in 46us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184853.436692:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784184853.436726:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784184853.436732:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:8368:x1870853265459200:12345-0@lo:104: 00010000:00010000:2.0:1784184853.436740:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436775:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784184853.436780:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:8368:x1870853265459200:12345-0@lo:104: Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184853.436784:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1784184853.436799:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784184853.436804:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436811:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784184853.436815:0:7491:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436823:0:7491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784184853.436830:0:7491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184853.436842:0:7491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784184853.436869:0:7491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436875:0:7491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784184853.436894:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436901:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c000/0x63160f6fbe8afea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afeb0 expref: -99 pid: 7485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436913:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784184853.436916:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436921:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c800 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784184853.436924:0:7491:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436931:0:7491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784184853.436937:0:7491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184853.436942:0:7491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784184853.436954:0:7491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436960:0:7491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784184853.436974:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436980:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c800/0x63160f6fbe8afe47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afe55 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.436989:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784184853.436992:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.437012:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b200 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784184853.437016:0:7491:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.437023:0:7491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784184853.437029:0:7491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784184853.437035:0:7491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784184853.437048:0:7491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.437054:0:7491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784184853.437069:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.437075:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b200/0x63160f6fbe8afdd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8afdd7 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184853.437088:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184853.437095:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184853.437097:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184853.437109:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265459328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784184853.437138:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184853.437161:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784184853.437167:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265459456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784184853.437187:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184853.437210:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784184853.437218:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265459584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784184853.437237:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184853.437284:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265458944:0@lo:104: 00000100:00100000:2.0:1784184853.437294:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265459072:0@lo:104: 00000100:00100000:2.0:1784184853.437300:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265459200:0@lo:104: 00010000:00010000:3.0:1784184853.438238:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184853.438264:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459328 00000100:00100000:3.0:1784184853.438270:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459328 00010000:00010000:3.0:1784184853.438303:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 19 pid: 5787 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184853.438359:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459456 00000100:00100000:3.0:1784184853.438362:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459456 00010000:00010000:3.0:1784184853.438374:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 20 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184853.438398:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459584 00000100:00100000:3.0:1784184853.438401:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459584 00010000:00010000:3.0:1784184853.438411:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896f600/0x63160f6fbe8afdd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 21 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184853.438424:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784184853.438430:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+21:3315:x1870853265459328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784184853.438440:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184853.438446:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 21 pid: 5787 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438455:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 21 pid: 5787 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438471:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896e200/0x63160f6fbe8afeb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afea9 expref: 21 pid: 5787 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438485:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184853.438526:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+20:3315:x1870853265459328:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184853.438533:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784184853.438556:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784184853.438562:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265459456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784184853.438575:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184853.438579:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 19 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438588:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 19 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438598:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8afe55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afe47 expref: 19 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438606:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184853.438626:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:3315:x1870853265459456:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184853.438633:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784184853.438646:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784184853.438650:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:3314:x1870853265459584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784184853.438657:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184853.438662:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896f600/0x63160f6fbe8afdd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 17 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438670:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896f600/0x63160f6fbe8afdd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 17 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438681:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896f600/0x63160f6fbe8afdd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8afdd0 expref: 17 pid: 5786 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.438690:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184853.438714:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3314:x1870853265459584:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184853.438728:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784184853.438769:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265459584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784184853.438795:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265459456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784184853.438802:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265459328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784184853.439579:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184853.442456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184853.442600:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216256 00000100:00100000:3.0:1784184853.442610:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216256 00010000:00010000:3.0:1784184853.442656:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 10 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184853.442688:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1784184853.442696:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2355:x1870853239216256:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184853.442710:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184853.442716:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 10 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442727:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 10 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442748:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442756:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442772:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442794:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442800:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442806:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442812:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971c00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784184853.442816:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442823:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442832:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.442842:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184853.442898:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2355:x1870853239216256:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 203us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184853.442905:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:3.0:1784184853.442965:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8aff6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d3e expref: 9 pid: 5784 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184853.442978:0:8368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8368:1870853265458816:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184853.443012:0:8368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.443028:0:8368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.443034:0:8368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184853.443039:0:8368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971c00/0x63160f6fbe8b000e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184853.707797:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784184853.707821:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265459712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784184853.707895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184853.707953:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459712 00000100:00100000:2.0:1784184853.707961:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459712 00000100:00100000:2.0:1784184853.710431:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784184853.710453:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265459712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784184853.710496:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184853.710592:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265459712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184853.710600:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1784184853.710619:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee1180 x1870853265459712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184853.710788:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265459712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184854.026620:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184855.050754:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784184855.050943:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784184855.050947:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbfbf1800 from 4 10000000:01000000:0.0:1784184855.050951:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784184855.050994:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184855.051006:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184855.051026:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184855.051050:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265459840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784184855.051112:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184855.051162:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459840 00000100:00100000:0.0:1784184855.051162:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8e180 going to sleep for 11 seconds 00000100:00100000:2.0:1784184855.051186:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459840 00000100:00100000:2.0:1784184855.051243:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784184855.051252:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265459840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184855.051267:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184855.051281:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0015 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184855.051911:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184855.051929:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184855.051938:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971e00, rc 0) 00000100:00100000:3.0:1784184855.052997:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265459840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1740us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184855.053008:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784184855.053029:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265459840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784184855.053062:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184855.053074:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184855.053208:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.053239:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184855.053275:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7dcc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184855.053367:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265459968 00000100:00100000:1.0:1784184855.053374:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265459968 00000100:00100000:1.0:1784184855.053425:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784184855.053433:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265459968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.053696:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265459968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.053704:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784184855.054014:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.054049:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.054093:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184855.054124:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7dcc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184855.054231:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460096 00000100:00100000:1.0:1784184855.054236:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460096 00000100:00100000:1.0:1784184855.054270:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784184855.054277:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265460096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.054477:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265460096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.054484:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784184855.057289:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.058593:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8437:1870853265460224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184855.058702:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184855.058744:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7dccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784184855.058766:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460224 00000100:00100000:2.0:1784184855.058774:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460224 00000100:00100000:2.0:1784184855.058827:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784184855.058836:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8437:x1870853265460224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184855.059086:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8437:x1870853265460224:12345-0@lo:502:llog_process_th.0 Request processed in 251us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184855.059095:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784184855.059285:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8437:1870853265460224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784184855.059311:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784184855.059471:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184855.059475:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784184855.059482:0:8437:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fbfbf1800 00000020:00000080:3.0:1784184855.059485:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784184855.059607:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8437:1870853265460352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784184855.059645:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184855.059665:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7dccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184855.059732:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460352 00000100:00100000:0.0:1784184855.059737:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460352 00000100:00100000:0.0:1784184855.059772:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784184855.059779:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8437:x1870853265460352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184855.059916:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:8437:x1870853265460352:12345-0@lo:502:llog_process_th.0 Request processed in 137us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184855.059924:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784184855.060000:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8437:1870853265460352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784184855.060019:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784184855.060023:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784184855.060025:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784184855.060028:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784184855.060182:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784184855.060200:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784184855.060210:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184855.060221:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184855.060231:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784184855.060234:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fc0d20000 from 4 10000000:01000000:0.0:1784184855.060237:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784184855.060261:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184855.060269:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184855.060288:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184855.060303:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784184855.060383:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184855.060403:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184855.060478:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460480 00000100:00100000:3.0:1784184855.060483:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460480 00000100:00100000:3.0:1784184855.060509:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784184855.060516:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265460480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184855.060524:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184855.060536:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0023 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184855.060558:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184855.060570:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184855.060585:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164be00, rc 0) 00000100:00100000:3.0:1784184855.060616:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265460480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184855.060622:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784184855.060654:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184855.060666:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184855.060675:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184855.060715:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.060740:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184855.060752:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7dcc540 going to sleep for 11 seconds 00000100:00100000:3.0:1784184855.060763:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460608 00000100:00100000:3.0:1784184855.060766:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460608 00000100:00100000:3.0:1784184855.060784:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784184855.060790:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265460608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.060983:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265460608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184855.061153:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784184855.061195:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.061233:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.061270:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184855.061300:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7dcc540 going to sleep for 11 seconds 00000100:00100000:2.0:1784184855.061414:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460736 00000100:00100000:2.0:1784184855.061420:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460736 00000100:00100000:3.0:1784184855.061463:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784184855.061482:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265460736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.062227:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265460736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 754us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184855.062235:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784184855.063828:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265460736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184855.064530:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8438:1870853265460864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184855.064605:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184855.064650:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184855.064773:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460864 00000100:00100000:1.0:1784184855.064779:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460864 00000100:00100000:1.0:1784184855.064862:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784184855.064872:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8438:x1870853265460864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184855.065104:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8438:x1870853265460864:12345-0@lo:502:llog_process_th.0 Request processed in 233us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.065111:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784184855.065568:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8438:1870853265460864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784184855.065594:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784184855.065603:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184855.065605:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784184855.065614:0:8438:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fc0d20000 00000020:00000080:0.0:1784184855.065616:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784184855.065680:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8438:1870853265460992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184855.065717:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184855.065837:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784184855.065874:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265460992 00000100:00100000:2.0:1784184855.065880:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265460992 00000100:00100000:2.0:1784184855.065904:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1784184855.065910:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8438:x1870853265460992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184855.066247:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:8438:x1870853265460992:12345-0@lo:502:llog_process_th.0 Request processed in 335us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184855.066261:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784184855.066488:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8438:1870853265460992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784184855.066509:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784184855.066514:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184855.066516:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784184855.066520:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784184855.066811:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784184855.066832:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784184855.066842:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184855.066853:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184855.066874:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784184855.066877:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5f85958000 from 4 10000000:01000000:1.0:1784184855.066880:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784184855.066906:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184855.066914:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184855.066923:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184855.066939:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265461120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.066971:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184855.067043:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb712acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184855.067149:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265461120 00000100:00100000:2.0:1784184855.067155:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265461120 00000100:00100000:2.0:1784184855.067453:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784184855.067462:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265461120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184855.067482:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184855.067495:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0031 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184855.067518:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184855.067529:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184855.067538:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970a00, rc 0) 00000100:00100000:2.0:1784184855.067575:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265461120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184855.067581:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784184855.067645:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265461120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784184855.067658:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184855.067667:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184855.067716:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265461248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.067742:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184855.067758:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb712acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184855.067770:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265461248 00000100:00100000:1.0:1784184855.067774:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265461248 00000100:00100000:1.0:1784184855.067806:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784184855.067812:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265461248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.068052:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265461248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.068070:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784184855.068104:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265461248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.068129:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265461376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.068164:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184855.068177:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb712acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184855.068188:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265461376 00000100:00100000:1.0:1784184855.068191:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265461376 00000100:00100000:1.0:1784184855.068211:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784184855.068217:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265461376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.068379:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265461376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.068386:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784184855.068420:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265461376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.068577:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8439:1870853265461504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184855.068612:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184855.068631:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265461504 00000100:00100000:1.0:1784184855.068635:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265461504 00000100:00100000:1.0:1784184855.068655:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784184855.068660:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:8439:x1870853265461504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184855.068777:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:8439:x1870853265461504:12345-0@lo:502:llog_process_th.0 Request processed in 116us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.068791:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784184855.068817:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb712af00 going to sleep for 11 seconds 00000100:00100000:1.0:1784184855.068830:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8439:1870853265461504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784184855.068848:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784184855.068856:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784184855.068858:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784184855.068864:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5f85958000 00000020:00000080:1.0:1784184855.068866:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784184855.068922:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8439:1870853265461632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184855.068953:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184855.068970:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265461632 00000100:00100000:1.0:1784184855.068974:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265461632 00000100:00100000:1.0:1784184855.068992:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784184855.068998:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:8439:x1870853265461632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184855.069103:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:8439:x1870853265461632:12345-0@lo:502:llog_process_th.0 Request processed in 103us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.069110:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784184855.069145:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb712af00 going to sleep for 11 seconds 00000100:00100000:1.0:1784184855.069157:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:8439:1870853265461632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784184855.069175:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784184855.069180:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784184855.069182:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784184855.069186:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784184855.069233:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784184855.069251:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784184855.069260:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184855.069277:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184855.317823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184855.320184:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216384 00000100:00100000:3.0:1784184855.320199:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216384 00000100:00100000:3.0:1784184855.320255:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:3.0:1784184855.320264:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+9:5573:x1870853239216384:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184855.320283:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184855.320300:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d7d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184855.320327:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184855.320367:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184855.320375:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a400, rc 0) 00000100:00100000:3.0:1784184855.320435:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216384:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 171us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184855.320443:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:0.0:1784184855.330413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184855.330492:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216512 00000100:00100000:3.0:1784184855.330502:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216512 00000100:00100000:3.0:1784184855.330559:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:3.0:1784184855.330569:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216512:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184855.330863:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216512:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 294us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184855.330872:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:3.0:1784184855.337574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184855.338242:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216640 00000100:00100000:1.0:1784184855.338255:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216640 00000100:00100000:1.0:1784184855.338384:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 192 00000100:00100000:1.0:1784184855.338396:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216640:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184855.338610:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:5573:x1870853239216640:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 215us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.338618:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 192 00000100:00100000:3.0:1784184855.342264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184855.342469:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216768 00000100:00100000:0.0:1784184855.342479:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216768 00000100:00100000:0.0:1784184855.342529:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 193 00000100:00100000:0.0:1784184855.342538:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:6135:x1870853239216768:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784184855.342790:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:6135:x1870853239216768:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 253us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184855.342798:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 193 00000100:00100000:0.0:1784184855.345826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184855.345920:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239216896 00000100:00100000:1.0:1784184855.345930:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239216896 00000100:00100000:1.0:1784184855.345990:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:1.0:1784184855.346000:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:6135:x1870853239216896:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784184855.346253:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:6135:x1870853239216896:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 252us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184855.346261:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:0.0:1784184855.632374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184855.632414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184855.632437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184855.632468:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217024 00000100:00100000:0.0:1784184855.632477:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217024 00000100:00100000:0.0:1784184855.632539:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1784184855.632550:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239217024:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184855.632644:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239217024:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184855.632652:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1784184855.632677:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217152 00000100:00100000:0.0:1784184855.632681:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217152 00000100:00100000:0.0:1784184855.632702:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217280 00000100:00100000:0.0:1784184855.632705:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217280 00000100:00100000:0.0:1784184855.632720:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1784184855.632726:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239217152:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184855.632757:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239217152:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184855.632778:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1784184855.632790:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1784184855.632797:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239217280:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184855.632826:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239217280:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184855.632832:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00080000:0.0:1784184855.632847:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784184855.632852:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784184855.632854:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784184856.078226:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184857.098500:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184857.293443:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265461888:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293512:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184857.293557:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265462400:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293581:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184857.293611:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784184857.293616:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265461760:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293642:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184857.293669:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265462272:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293690:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184857.293715:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265462016:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293736:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184857.293754:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184857.293759:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265462144:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293778:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184857.293808:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265461888 00000100:00100000:1.0:1784184857.293815:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265461888 00000100:00100000:1.0:1784184857.293853:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462272 00000100:00100000:1.0:1784184857.293855:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462272 00000100:00100000:1.0:1784184857.293873:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462016 00000100:00100000:1.0:1784184857.293876:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462016 00000100:00100000:1.0:1784184857.293890:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784184857.293897:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265461888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293942:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265461888:12345-0@lo:400:kworker.0 Request processed in 45us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184857.293949:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784184857.293963:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784184857.293969:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265462272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.293993:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265462272:12345-0@lo:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184857.293999:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784184857.294009:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784184857.294014:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265462016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.294041:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265462016:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184857.294055:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784184857.294073:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462400 00000100:00100000:1.0:1784184857.294076:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462400 00000100:00100000:1.0:1784184857.294099:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462144 00000100:00100000:1.0:1784184857.294101:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462144 00000100:00100000:1.0:1784184857.294115:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784184857.294120:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265462400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.294162:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265462400:12345-0@lo:400:kworker.0 Request processed in 42us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184857.294169:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784184857.294179:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784184857.294185:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265462144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.294209:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265462144:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184857.294214:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1784184857.294239:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784184857.294243:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784184857.294245:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784184857.294270:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d1500 x1870853265462144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184857.294283:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265462144:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.294294:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265462016:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.294349:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265462272:0@lo:400:kworker.0 00000100:00100000:1.0:1784184857.294361:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265461888:0@lo:400:kworker.0 00010000:00080000:1.0:1784184857.294369:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7dd9f80 x1870853265462400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184857.294383:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265462400:0@lo:400:kworker.0 00000100:00100000:3.0:1784184857.294693:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265461760 00000100:00100000:3.0:1784184857.294699:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265461760 00000100:00100000:3.0:1784184857.294728:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784184857.294736:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265461760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184857.294777:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265461760:12345-0@lo:400:kworker.0 Request processed in 42us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184857.294783:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784184857.295303:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265461760:0@lo:400:kworker.0 00000100:00100000:3.0:1784184857.298789:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784184857.307524:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265462528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184857.307617:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184857.313281:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462528 00000100:00100000:0.0:1784184857.313407:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462528 00000100:00100000:1.0:1784184857.313727:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784184857.313739:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265462528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784184857.313778:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184857.313870:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265462528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (6253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184857.313877:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1784184857.314060:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee2a00 x1870853265462528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184857.314081:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265462528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784184858.122631:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184858.828724:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184858.828748:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265462656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184858.828816:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184858.828913:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462656 00000100:00100000:3.0:1784184858.828921:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462656 00000100:00100000:3.0:1784184858.828975:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784184858.828984:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265462656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184858.829019:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184858.829064:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265462656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184858.829084:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1784184858.829328:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d6300 x1870853265462656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184858.829384:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265462656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784184859.148000:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184860.171465:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184860.759121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184860.759391:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217408 00000100:00100000:0.0:1784184860.759405:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217408 00000100:00100000:0.0:1784184860.759478:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:0.0:1784184860.759491:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239217408:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184860.759585:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239217408:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 95us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184860.759616:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:0.0:1784184860.763105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184860.763235:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217536 00000100:00100000:2.0:1784184860.763248:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217536 00000100:00100000:2.0:1784184860.763395:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1784184860.763408:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239217536:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184860.763510:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239217536:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 104us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184860.763542:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00080000:0.0:1784184860.764390:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184860.780039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184860.780101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184860.780188:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217664 00000100:00100000:3.0:1784184860.780203:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217664 00000100:00100000:3.0:1784184860.780300:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217792 00000100:00100000:3.0:1784184860.780304:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217792 00000100:00100000:3.0:1784184860.780358:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1784184860.780373:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2352:x1870853239217664:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1784184860.780423:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8aff7b 00000100:00080000:3.0:1784184860.780436:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ab800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784184860.780487:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784184860.781006:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+2:2352:x1870853239217664:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 634us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184860.781015:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1784184860.781039:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1784184860.781047:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2352:x1870853239217792:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1784184860.781065:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8aff82 00000100:00080000:3.0:1784184860.781073:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5faec56800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784184860.781099:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784184860.781327:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+2:2352:x1870853239217792:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 279us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184860.781363:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00010000:00010000:3.0:1784184860.781445:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184860.781451:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784184860.781597:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784184860.781603:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784184861.195941:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784184861.989467:0:8667:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1784184862.220972:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184862.410630:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265462784:0@lo:400:kworker.0 00000100:00100000:0.0:1784184862.410671:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265463040:0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.410734:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265462912:0@lo:400:kworker.0 00000100:00100000:2.0:1784184862.411641:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265463168:0@lo:400:kworker.0 00000100:00100000:2.0:1784184862.411699:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184862.411851:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784184862.411862:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184862.411894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184862.411937:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463168 00000100:00100000:2.0:1784184862.411946:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463168 00000100:00100000:2.0:1784184862.412021:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784184862.412031:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265463168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184862.412092:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265463168:12345-0@lo:400:kworker.0 Request processed in 62us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184862.412101:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784184862.412133:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463552 00000100:00100000:2.0:1784184862.412137:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463552 00000100:00100000:2.0:1784184862.412181:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784184862.412189:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265463552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184862.412225:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184862.412270:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265463552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184862.412293:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1784184862.412312:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784184862.412316:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184862.412466:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184862.412491:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265463424:0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.412515:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184862.412535:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784184862.412542:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265463296:0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.412565:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184862.412594:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462912 00000100:00100000:1.0:1784184862.412600:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462912 00000100:00100000:1.0:1784184862.412630:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463296 00000100:00100000:1.0:1784184862.412633:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463296 00000100:00100000:1.0:1784184862.412660:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784184862.412666:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265462912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.412704:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265462912:12345-0@lo:400:kworker.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184862.412710:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784184862.412732:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784184862.412738:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265463296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.412766:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265463296:12345-0@lo:400:kworker.0 Request processed in 28us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184862.412772:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1784184862.412876:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee1f80 x1870853265463552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184862.412900:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184862.412997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184862.413283:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463040 00000100:00100000:1.0:1784184862.413288:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463040 00000100:00100000:1.0:1784184862.413308:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784184862.413314:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265463040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.413398:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265463040:12345-0@lo:400:kworker.0 Request processed in 83us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184862.413405:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784184862.413428:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463424 00000100:00100000:1.0:1784184862.413432:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463424 00000100:00100000:1.0:1784184862.413458:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784184862.413465:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265463424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.413501:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265463424:12345-0@lo:400:kworker.0 Request processed in 36us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184862.413507:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784184862.413622:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265463296:0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.413634:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265462912:0@lo:400:kworker.0 00010000:00080000:1.0:1784184862.413646:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83364700 x1870853265463424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184862.413655:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265463424:0@lo:400:kworker.0 00000100:00100000:0.0:1784184862.413752:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265463040:0@lo:400:kworker.0 00000100:00100000:3.0:1784184862.414194:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184862.414389:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265462784 00000100:00100000:1.0:1784184862.414409:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265462784 00000100:00100000:1.0:1784184862.414448:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784184862.414454:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265462784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.414507:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265462784:12345-0@lo:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184862.414638:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265462784:0@lo:400:kworker.0 00000100:00100000:1.0:1784184862.414687:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:2.0:1784184862.414906:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7121c00 x1870853265463168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184862.414920:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265463168:0@lo:400:kworker.0 00000100:00080000:2.0:1784184862.414955:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784184863.242598:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184863.951070:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265463680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184863.951164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184863.952898:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463680 00000100:00100000:3.0:1784184863.952914:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463680 00000100:00100000:3.0:1784184863.953112:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784184863.953123:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265463680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184863.953163:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184863.953246:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265463680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184863.953254:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1784184863.953392:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d6d80 x1870853265463680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184863.953414:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265463680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784184864.266704:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784184864.530466:0:7986:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:3.0:1784184864.530476:0:7986:0:(genops.c:906:class_export_put()) final put ffff9b5faec53800/89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:3.0:1784184864.530565:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5faec53800/89741aef-63f5-4e1f-9ce7-defb19b62903 for lustre-OST0001 00000020:00000080:3.0:1784184864.530606:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5faec56800 for lustre-OST0001 00010000:00010000:1.0:1784184865.291496:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784184865.534476:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:2.0:1784184865.534485:0:6613:0:(genops.c:906:class_export_put()) final put ffff9b5fb74a8800/89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:0.0:1784184865.535250:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb74a8800/89741aef-63f5-4e1f-9ce7-defb19b62903 for lustre-OST0000 00000020:00000080:0.0:1784184865.535310:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fb74ab800 for lustre-OST0000 00000100:00100000:3.0:1784184865.872661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184865.872696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184865.872731:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239217920 00000100:00100000:3.0:1784184865.872741:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239217920 00000100:00100000:3.0:1784184865.872800:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:3.0:1784184865.873128:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239217920:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184865.873221:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239217920:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 99us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184865.873228:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:1.0:1784184865.875013:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218048 00000100:00100000:1.0:1784184865.875025:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218048 00000100:00100000:1.0:1784184865.875091:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1784184865.875101:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239218048:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184865.875163:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239218048:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 63us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184865.875170:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00080000:3.0:1784184865.875584:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784184866.314560:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184867.342646:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184867.533539:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265463808:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.533640:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184867.533699:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265464320:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.533737:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184867.533766:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784184867.533773:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265463936:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.533797:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184867.533815:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265464448:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.533838:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184867.533872:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265464064:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.533906:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184867.533926:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784184867.533932:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265464192:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.533954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184867.533984:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463808 00000100:00100000:3.0:1784184867.533991:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463808 00000100:00100000:3.0:1784184867.534033:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784184867.534042:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265463808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534090:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265463808:12345-0@lo:400:kworker.0 Request processed in 48us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184867.534097:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784184867.534126:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464320 00000100:00100000:3.0:1784184867.534129:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464320 00000100:00100000:3.0:1784184867.534177:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265463936 00000100:00100000:3.0:1784184867.534181:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265463936 00000100:00100000:3.0:1784184867.534194:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464064 00000100:00100000:3.0:1784184867.534196:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464064 00000100:00100000:3.0:1784184867.534211:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784184867.534227:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265464320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534267:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265464320:12345-0@lo:400:kworker.0 Request processed in 42us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184867.534274:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784184867.534287:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784184867.534293:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265463936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534318:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265463936:12345-0@lo:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184867.534324:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784184867.534373:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784184867.534380:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265464064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534411:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265464064:12345-0@lo:400:kworker.0 Request processed in 33us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184867.534417:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784184867.534437:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464448 00000100:00100000:3.0:1784184867.534440:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464448 00000100:00100000:3.0:1784184867.534464:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464192 00000100:00100000:3.0:1784184867.534467:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464192 00000100:00100000:3.0:1784184867.534481:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784184867.534486:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265464448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534515:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265464448:12345-0@lo:400:kworker.0 Request processed in 29us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184867.534520:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784184867.534530:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784184867.534535:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265464192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534562:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265464192:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184867.534577:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784184867.534623:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265463936:0@lo:400:kworker.0 00010000:00080000:3.0:1784184867.534638:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d5180 x1870853265464448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184867.534649:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265464448:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534659:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265463808:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534669:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265464320:0@lo:400:kworker.0 00000100:00080000:3.0:1784184867.534699:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784184867.534703:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784184867.534706:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784184867.534724:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d6d80 x1870853265464192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184867.534734:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265464192:0@lo:400:kworker.0 00000100:00100000:3.0:1784184867.534744:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265464064:0@lo:400:kworker.0 00000100:00100000:2.0:1784184867.544458:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265464576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184867.544538:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184867.544644:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464576 00000100:00100000:0.0:1784184867.544660:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464576 00000100:00100000:0.0:1784184867.545176:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784184867.545191:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265464576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784184867.545247:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184867.545379:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265464576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184867.545388:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1784184867.548413:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83366300 x1870853265464576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184867.548465:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265464576:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784184867.751190:0:8911:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing yml_node 00010000:00010000:1.0:1784184868.369951:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184869.079157:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265464704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184869.079288:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184869.079641:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464704 00000100:00100000:3.0:1784184869.079664:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464704 00000100:00100000:3.0:1784184869.079756:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784184869.079768:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265464704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184869.079818:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184869.079880:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265464704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184869.079889:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1784184869.080587:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184869.080666:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d7100 x1870853265464704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184869.080691:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265464704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784184869.388533:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184870.410620:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184870.996286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184870.996395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184870.996411:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218176 00000100:00100000:0.0:1784184870.996425:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218176 00000100:00100000:0.0:1784184870.996498:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:0.0:1784184870.996511:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239218176:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184870.996615:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239218176:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 106us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184870.996633:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:1.0:1784184870.998306:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218304 00000100:00100000:1.0:1784184870.998324:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218304 00000100:00100000:1.0:1784184870.998470:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1784184870.998481:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239218304:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184870.998572:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239218304:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 92us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184870.998580:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00080000:0.0:1784184871.000431:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784184871.436587:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184872.459744:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184872.650637:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265464960:0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.650735:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184872.650791:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265465472:0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.650816:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184872.650847:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784184872.650851:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265464832:0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.650876:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184872.650894:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265465344:0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.650910:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184872.650932:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265465216:0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.650952:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184872.650968:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184872.650972:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265465088:0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.650991:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184872.651017:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464960 00000100:00100000:1.0:1784184872.651035:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464960 00000100:00100000:1.0:1784184872.652319:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465344 00000100:00100000:1.0:1784184872.652351:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465344 00000100:00100000:1.0:1784184872.652386:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465088 00000100:00100000:1.0:1784184872.652389:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465088 00000100:00100000:1.0:1784184872.652409:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784184872.652418:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265464960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.652509:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265464960:12345-0@lo:400:kworker.0 Request processed in 92us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184872.652516:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784184872.652534:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784184872.652539:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265465344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.652577:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265465344:12345-0@lo:400:kworker.0 Request processed in 38us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184872.652583:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784184872.652592:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784184872.652597:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265465088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.652622:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265465088:12345-0@lo:400:kworker.0 Request processed in 25us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184872.652627:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784184872.652652:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465472 00000100:00100000:1.0:1784184872.652656:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465472 00000100:00100000:1.0:1784184872.652680:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465216 00000100:00100000:1.0:1784184872.652683:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465216 00000100:00100000:1.0:1784184872.652694:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784184872.652699:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265465472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.652728:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265465472:12345-0@lo:400:kworker.0 Request processed in 29us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184872.652734:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784184872.652742:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184872.652746:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265465216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.652767:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265465216:12345-0@lo:400:kworker.0 Request processed in 21us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184872.652773:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184872.652789:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265464832 00000100:00100000:1.0:1784184872.652792:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265464832 00000100:00100000:1.0:1784184872.652816:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784184872.652821:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265464832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184872.652860:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265464832:12345-0@lo:400:kworker.0 Request processed in 39us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184872.652866:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1784184872.661438:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265465600:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784184872.661451:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784184872.661459:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784184872.661463:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184872.661527:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265465088:0@lo:400:kworker.0 00010000:00080000:0.0:1784184872.669973:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7dd8000 x1870853265465216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184872.669998:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265465216:0@lo:400:kworker.0 00000100:00100000:0.0:1784184872.672666:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184872.672877:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465600 00000100:00100000:1.0:1784184872.672889:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465600 00000100:00100000:1.0:1784184872.672964:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784184872.672978:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265465600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784184872.673047:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184872.673130:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265465600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184872.673138:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1784184872.673821:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83365880 x1870853265465600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184872.673853:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265465600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184872.674264:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265464832:0@lo:400:kworker.0 00000100:00100000:2.0:1784184872.674283:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265465344:0@lo:400:kworker.0 00000100:00100000:2.0:1784184872.674298:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265464960:0@lo:400:kworker.0 00010000:00080000:2.0:1784184872.674310:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7ddb480 x1870853265465472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184872.674488:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265465472:0@lo:400:kworker.0 00000001:02000400:3.0:1784184872.880010:0:9102:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:0.0:1784184873.482575:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184874.189205:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265465728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184874.189317:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184874.189511:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465728 00000100:00100000:3.0:1784184874.189522:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465728 00000100:00100000:3.0:1784184874.189607:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784184874.189622:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265465728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184874.189680:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184874.189757:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265465728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184874.189765:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1784184874.190239:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784184874.191587:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d6300 x1870853265465728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184874.191616:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265465728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784184874.506611:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184875.542319:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784184875.979906:0:9200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00000100:00100000:3.0:1784184876.115953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184876.115991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184876.116033:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218432 00000100:00100000:3.0:1784184876.116042:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218432 00000100:00100000:3.0:1784184876.116090:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:3.0:1784184876.116100:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239218432:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184876.116172:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239218432:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184876.116180:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:3.0:1784184876.116214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218560 00000100:00100000:3.0:1784184876.116218:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218560 00000100:00100000:3.0:1784184876.116260:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1784184876.119994:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239218560:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184876.120110:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239218560:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 133us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184876.120119:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00080000:3.0:1784184876.120159:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784184876.558078:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184877.581828:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184877.770723:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784184877.770747:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265465856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184877.770817:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184877.771184:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465856 00000100:00100000:1.0:1784184877.771193:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465856 00000100:00100000:1.0:1784184877.771259:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784184877.771268:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265465856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784184877.771303:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184877.771368:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265465856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184877.771375:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1784184877.771430:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83364000 x1870853265465856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184877.771465:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265465856:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784184877.771693:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184877.771856:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265466112:0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.771904:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184877.771936:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184877.771941:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265466240:0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.771964:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184877.772001:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265466112 00000100:00100000:0.0:1784184877.772006:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265466112 00000100:00100000:0.0:1784184877.772035:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265466240 00000100:00100000:0.0:1784184877.772038:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265466240 00000100:00100000:0.0:1784184877.772060:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784184877.772066:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265466112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.772100:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265466112:12345-0@lo:400:kworker.0 Request processed in 34us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184877.772105:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784184877.772119:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784184877.772125:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265466240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.772151:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265466240:12345-0@lo:400:kworker.0 Request processed in 27us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184877.772157:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1784184877.772191:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184877.772209:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265466240:0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.772231:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265466112:0@lo:400:kworker.0 00000100:00100000:3.0:1784184877.772359:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265466368:0@lo:400:kworker.0 00000100:00100000:3.0:1784184877.772388:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184877.772425:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784184877.772431:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265465984:0@lo:400:kworker.0 00000100:00100000:3.0:1784184877.772455:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184877.772472:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265466496:0@lo:400:kworker.0 00000100:00100000:3.0:1784184877.772490:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184877.772551:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265466368 00000100:00100000:0.0:1784184877.772555:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265466368 00000100:00100000:0.0:1784184877.772601:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784184877.772609:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265466368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.772646:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265466368:12345-0@lo:400:kworker.0 Request processed in 38us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184877.772653:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1784184877.772678:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee0a80 x1870853265466368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184877.772688:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265466368:0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.772707:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265466496 00000100:00100000:0.0:1784184877.772710:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265466496 00000100:00100000:0.0:1784184877.772733:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784184877.772738:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265466496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184877.772771:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265466496:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184877.772777:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784184877.772800:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265466496:0@lo:400:kworker.0 00000100:00080000:3.0:1784184877.772910:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784184877.772915:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184877.773126:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265465984 00000100:00100000:1.0:1784184877.773130:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265465984 00000100:00100000:1.0:1784184877.773209:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784184877.773217:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265465984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184877.773261:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265465984:12345-0@lo:400:kworker.0 Request processed in 45us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184877.773267:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784184877.773355:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265465984:0@lo:400:kworker.0 00010000:00010000:0.0:1784184878.602562:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784184878.793103:0:9297:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00000100:00100000:3.0:1784184879.306753:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784184879.306776:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265466624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784184879.306846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184879.306922:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265466624 00000100:00100000:3.0:1784184879.306930:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265466624 00000100:00100000:3.0:1784184879.306991:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784184879.307000:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265466624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184879.307036:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184879.307080:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265466624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184879.307086:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1784184879.307123:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784184879.307151:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d6a00 x1870853265466624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184879.307169:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265466624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784184879.629813:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184880.651103:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784184881.118009:0:9346:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Jul 16 02:54:38 EDT 2026 00000100:00100000:3.0:1784184881.234733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184881.234778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184881.234847:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218816 00000100:00100000:2.0:1784184881.234857:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218816 00000100:00100000:2.0:1784184881.234940:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1784184881.234951:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239218816:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184881.235027:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239218816:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184881.235033:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1784184881.235161:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218688 00000100:00100000:0.0:1784184881.235165:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218688 00000100:00100000:0.0:1784184881.235219:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:0.0:1784184881.235242:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239218688:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184881.235274:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239218688:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 34us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184881.235280:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00080000:3.0:1784184881.235657:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784184881.678507:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184882.698658:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184882.890642:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265466880:0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.890717:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184882.890848:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184882.890873:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265466752:0@lo:400:kworker.0 00000100:00100000:1.0:1784184882.890932:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184882.891001:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184882.891009:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265467136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184882.891012:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265466752 00000100:00100000:3.0:1784184882.891019:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265466752 00000100:00100000:1.0:1784184882.891051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184882.891066:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784184882.891074:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265466752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184882.891076:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467136 00000100:00100000:1.0:1784184882.891079:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467136 00000100:00100000:1.0:1784184882.891115:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784184882.891121:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265466752:12345-0@lo:400:kworker.0 Request processed in 48us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184882.891121:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265467136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184882.891128:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00002000:00000024:1.0:1784184882.891148:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184882.891182:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265467136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184882.891188:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1784184882.891205:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784184882.891233:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7120000 x1870853265467136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184882.891263:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265467136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184882.891293:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265466752:0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.891541:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784184882.891549:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265467008:0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.891580:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184882.891607:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265466880 00000100:00100000:2.0:1784184882.891611:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265466880 00000100:00100000:2.0:1784184882.891649:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467008 00000100:00100000:2.0:1784184882.891652:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467008 00000100:00100000:2.0:1784184882.891676:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784184882.891682:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265466880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.891720:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265466880:12345-0@lo:400:kworker.0 Request processed in 38us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184882.891737:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784184882.891758:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784184882.891764:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265467008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.891794:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265467008:12345-0@lo:400:kworker.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184882.891800:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784184882.891842:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265467008:0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.891852:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265466880:0@lo:400:kworker.0 00000100:00080000:1.0:1784184882.894471:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184882.895544:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265467264:0@lo:400:kworker.0 00000100:00100000:1.0:1784184882.895622:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184882.895729:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467264 00000100:00100000:3.0:1784184882.895738:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467264 00000100:00100000:3.0:1784184882.895804:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784184882.895814:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265467264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.897857:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265467392:0@lo:400:kworker.0 00000100:00100000:2.0:1784184882.897951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184882.898807:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467392 00000100:00100000:0.0:1784184882.898829:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467392 00000100:00100000:0.0:1784184882.898909:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784184882.898922:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265467392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184882.898993:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265467392:12345-0@lo:400:kworker.0 Request processed in 76us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184882.899000:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784184882.899364:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265467392:0@lo:400:kworker.0 00000100:00080000:0.0:1784184882.899479:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784184882.899484:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784184882.901728:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265467264:12345-0@lo:400:kworker.0 Request processed in 5905us (6095us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184882.901745:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1784184882.902051:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83365c00 x1870853265467264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184882.902070:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265467264:0@lo:400:kworker.0 00010000:00010000:1.0:1784184883.726492:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184884.428384:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184884.428409:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265467520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184884.428547:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184884.428613:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467520 00000100:00100000:0.0:1784184884.428621:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467520 00000100:00100000:0.0:1784184884.428749:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784184884.428758:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265467520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184884.428793:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184884.428836:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265467520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184884.428845:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1784184884.428878:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184884.428917:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83365f80 x1870853265467520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184884.428935:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265467520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784184884.746852:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184885.770817:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184886.356703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184886.356767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184886.356988:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239218944 00000100:00100000:3.0:1784184886.357000:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239218944 00000100:00100000:3.0:1784184886.357073:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:3.0:1784184886.357084:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239218944:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184886.357177:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2354:x1870853239218944:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 95us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184886.357206:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:0.0:1784184886.358638:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219072 00000100:00100000:0.0:1784184886.358655:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219072 00000100:00100000:0.0:1784184886.358751:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1784184886.358762:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239219072:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184886.359146:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239219072:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 385us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184886.359154:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00080000:2.0:1784184886.359224:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784184886.796328:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184887.824292:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184888.010635:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265467904:0@lo:400:kworker.0 00000100:00100000:0.0:1784184888.010711:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184888.010721:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265467648:0@lo:400:kworker.0 00000100:00100000:1.0:1784184888.010753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184888.010767:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184888.010773:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265468032:0@lo:400:kworker.0 00000100:00100000:1.0:1784184888.010777:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265468160:0@lo:400:kworker.0 00000100:00100000:1.0:1784184888.010796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184888.010796:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184888.010823:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784184888.010829:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265467776:0@lo:400:kworker.0 00000100:00100000:0.0:1784184888.010837:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467904 00000100:00100000:0.0:1784184888.010843:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467904 00000100:00100000:1.0:1784184888.010849:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184888.010865:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265468288:0@lo:400:kworker.0 00000100:00100000:1.0:1784184888.010882:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184888.010893:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468160 00000100:00100000:0.0:1784184888.010897:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468160 00000100:00100000:1.0:1784184888.010903:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467648 00000100:00100000:1.0:1784184888.010906:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467648 00000100:00100000:0.0:1784184888.010910:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265467776 00000100:00100000:0.0:1784184888.010912:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265467776 00000100:00100000:1.0:1784184888.010932:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784184888.010937:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784184888.010940:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265467648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184888.010943:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265467904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184888.010983:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265467648:12345-0@lo:400:kworker.0 Request processed in 44us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184888.010983:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265467904:12345-0@lo:400:kworker.0 Request processed in 40us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184888.011002:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784184888.011002:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784184888.011029:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784184888.011034:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784184888.011035:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265468160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184888.011039:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265467776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184888.011063:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265467776:12345-0@lo:400:kworker.0 Request processed in 24us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184888.011063:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265468160:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184888.011069:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784184888.011104:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265467776:0@lo:400:kworker.0 00000100:00100000:2.0:1784184888.011113:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468032 00000100:00100000:1.0:1784184888.011114:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265467648:0@lo:400:kworker.0 00000100:00100000:2.0:1784184888.011116:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468032 00000100:00100000:1.0:1784184888.011121:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265468160:0@lo:400:kworker.0 00000100:00100000:2.0:1784184888.011143:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468288 00000100:00100000:2.0:1784184888.011154:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468288 00000100:00100000:2.0:1784184888.011173:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784184888.011178:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265468032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184888.011213:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265468032:12345-0@lo:400:kworker.0 Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184888.011219:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784184888.011230:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784184888.011236:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265468288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184888.011284:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265468288:12345-0@lo:400:kworker.0 Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184888.011291:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784184888.011436:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1784184888.011445:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83365180 x1870853265468288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184888.011456:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265468288:0@lo:400:kworker.0 00000100:00080000:0.0:1784184888.011457:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784184888.011461:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784184888.011463:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784184888.011487:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83365500 x1870853265468032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184888.011497:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265468032:0@lo:400:kworker.0 00000100:00100000:0.0:1784184888.011508:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265467904:0@lo:400:kworker.0 00000100:00100000:0.0:1784184888.011520:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265468416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184888.011546:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184888.011584:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468416 00000100:00100000:2.0:1784184888.011588:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468416 00000100:00100000:2.0:1784184888.011618:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784184888.011625:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265468416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184888.011667:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184888.011712:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265468416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184888.011719:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1784184888.011830:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee3b80 x1870853265468416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184888.011843:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265468416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784184888.844477:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184889.546676:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265468544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784184889.546751:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184889.546847:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468544 00000100:00100000:3.0:1784184889.546854:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468544 00000100:00100000:3.0:1784184889.546901:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784184889.546910:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265468544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184889.546945:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184889.546993:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265468544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184889.547000:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1784184889.547043:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc12d7100 x1870853265468544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184889.547062:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265468544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784184889.870030:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184890.896008:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184891.496089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184891.496144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184891.498316:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219328 00000100:00100000:0.0:1784184891.498372:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219328 00000100:00100000:0.0:1784184891.498467:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:0.0:1784184891.498480:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239219328:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184891.498590:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239219328:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 112us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184891.498598:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:3.0:1784184891.499230:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219200 00000100:00100000:3.0:1784184891.499238:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219200 00000100:00100000:3.0:1784184891.499292:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00100000:3.0:1784184891.499301:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239219200:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184891.499398:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239219200:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 97us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184891.499404:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00080000:2.0:1784184891.500278:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784184891.914932:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184892.939683:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184893.130963:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784184893.131153:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265468800:0@lo:400:kworker.0 00000100:00100000:0.0:1784184893.131287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184893.131400:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265468672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184893.131436:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184893.131934:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468800 00000100:00100000:3.0:1784184893.131944:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468800 00000100:00100000:3.0:1784184893.132019:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784184893.132030:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265468800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.132097:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265468800:12345-0@lo:400:kworker.0 Request processed in 70us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184893.132106:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1784184893.132151:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265468928:0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.132182:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184893.132220:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784184893.132227:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265469056:0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.132251:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184893.132285:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468928 00000100:00100000:3.0:1784184893.132289:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468928 00000100:00100000:3.0:1784184893.132319:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469056 00000100:00100000:3.0:1784184893.132323:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469056 00000100:00100000:3.0:1784184893.132402:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784184893.132408:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265468928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.132446:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265468928:12345-0@lo:400:kworker.0 Request processed in 38us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184893.132452:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784184893.132463:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784184893.132468:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265469056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.132492:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265469056:12345-0@lo:400:kworker.0 Request processed in 24us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184893.132497:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1784184893.132519:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184893.132545:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265469184:0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.132575:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184893.132596:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784184893.132601:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265469312:0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.132620:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184893.133041:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265468672 00000100:00100000:2.0:1784184893.133048:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265468672 00000100:00100000:0.0:1784184893.133161:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265468800:0@lo:400:kworker.0 00000100:00080000:1.0:1784184893.133393:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784184893.136204:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469184 00000100:00100000:2.0:1784184893.136309:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784184893.136459:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265468672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184893.136514:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184893.136671:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265468672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 349us (5232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184893.136680:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784184893.136910:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469184 00000100:00100000:3.0:1784184893.136995:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784184893.137004:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265469184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.137058:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265469184:12345-0@lo:400:kworker.0 Request processed in 56us (4481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184893.137064:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784184893.137121:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265469056:0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.137138:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265468928:0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.137175:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469312 00000100:00100000:3.0:1784184893.137179:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469312 00000100:00100000:3.0:1784184893.137484:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784184893.137494:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265469312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184893.137537:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265469312:12345-0@lo:400:kworker.0 Request processed in 45us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184893.137544:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784184893.137577:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265469312:0@lo:400:kworker.0 00010000:00080000:3.0:1784184893.137593:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbe4a80 x1870853265469184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184893.137605:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265469184:0@lo:400:kworker.0 00000100:00080000:1.0:1784184893.137893:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784184893.137900:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184893.138040:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee0a80 x1870853265468672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184893.138062:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265468672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784184893.962585:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184894.669310:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184894.669384:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265469440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184894.669477:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184894.669660:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469440 00000100:00100000:2.0:1784184894.669670:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469440 00000100:00100000:2.0:1784184894.669742:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784184894.669753:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265469440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784184894.669814:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184894.669873:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265469440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184894.669882:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1784184894.669931:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83364700 x1870853265469440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184894.672037:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265469440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784184894.986675:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184896.010739:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184896.592209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184896.592431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184896.592616:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219584 00000100:00100000:3.0:1784184896.592627:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219584 00000100:00100000:3.0:1784184896.592727:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:3.0:1784184896.592737:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239219584:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184896.592814:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239219584:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 79us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184896.592820:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00080000:1.0:1784184896.593130:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184896.593428:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219456 00000100:00100000:0.0:1784184896.593435:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219456 00000100:00100000:0.0:1784184896.593475:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:0.0:1784184896.593482:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239219456:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184896.593535:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2356:x1870853239219456:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 52us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184896.593541:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 210 00010000:00010000:2.0:1784184897.034505:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184898.067244:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184898.251632:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184898.251668:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265469568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184898.251738:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184898.251801:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469568 00000100:00100000:0.0:1784184898.251808:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469568 00000100:00100000:0.0:1784184898.251861:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784184898.251881:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265469568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784184898.251918:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184898.251978:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265469568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184898.251985:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1784184898.252006:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784184898.252140:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83364700 x1870853265469568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184898.252158:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265469568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184898.254679:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265469696:0@lo:400:kworker.0 00000100:00100000:2.0:1784184898.254699:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265470080:0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.254775:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265469824:0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.267705:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184898.267777:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184898.267791:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265470208:0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.267829:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184898.267879:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469824 00000100:00100000:1.0:1784184898.267887:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469824 00000100:00100000:1.0:1784184898.267928:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470208 00000100:00100000:1.0:1784184898.267931:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470208 00000100:00100000:1.0:1784184898.267970:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784184898.267978:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265469824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.268027:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265469824:12345-0@lo:400:kworker.0 Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184898.268034:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784184898.268049:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784184898.268054:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265470208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.268076:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265470208:12345-0@lo:400:kworker.0 Request processed in 23us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184898.268082:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784184898.268119:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265470208:0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.268128:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265469824:0@lo:400:kworker.0 00000100:00080000:1.0:1784184898.268514:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184898.269667:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184898.269733:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265469952:0@lo:400:kworker.0 00000100:00100000:2.0:1784184898.269773:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184898.269812:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469952 00000100:00100000:2.0:1784184898.269817:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469952 00000100:00100000:2.0:1784184898.269861:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784184898.269867:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265469952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184898.269908:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265469952:12345-0@lo:400:kworker.0 Request processed in 41us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184898.269914:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1784184898.269946:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184898.269978:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265469952:0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.271883:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470080 00000100:00100000:1.0:1784184898.271897:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470080 00000100:00100000:1.0:1784184898.271971:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784184898.271980:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265470080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.272060:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265470080:12345-0@lo:400:kworker.0 Request processed in 81us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184898.272068:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784184898.274913:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784184898.275033:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784184898.275096:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee0a80 x1870853265470080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184898.275112:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265470080:0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.276739:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265469696 00000100:00100000:1.0:1784184898.276763:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265469696 00000100:00100000:1.0:1784184898.276814:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784184898.276824:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265469696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184898.276898:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265469696:12345-0@lo:400:kworker.0 Request processed in 76us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184898.276905:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784184898.277253:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265469696:0@lo:400:kworker.0 00000001:02000400:1.0:1784184898.429137:0:9975:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:54:56 (1784184896) === 00000100:00100000:2.0:1784184899.001860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184899.001955:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219712 00000100:00100000:1.0:1784184899.001964:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219712 00000100:00100000:1.0:1784184899.002026:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:1.0:1784184899.002036:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+10:8129:x1870853239219712:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784184899.002052:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184899.002072:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8b0046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186d84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184899.002112:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8b0046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d84 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184899.002123:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8b0046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d84 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184899.002133:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f80031800, rc 0) 00000100:00100000:1.0:1784184899.002198:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8129:x1870853239219712:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 163us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.002206:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:1.0:1784184899.019226:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184899.019454:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219840 00000100:00100000:0.0:1784184899.019464:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219840 00000100:00100000:0.0:1784184899.019522:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:0.0:1784184899.019532:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8129:x1870853239219840:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784184899.020221:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8129:x1870853239219840:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 689us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184899.020230:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:0.0:1784184899.047122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184899.047266:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239219968 00000100:00100000:2.0:1784184899.047276:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239219968 00000100:00100000:2.0:1784184899.047370:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:2.0:1784184899.047380:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8129:x1870853239219968:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784184899.047638:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8129:x1870853239219968:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 244us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184899.047648:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:2.0:1784184899.051564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184899.051694:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220096 00000100:00100000:0.0:1784184899.051704:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220096 00000100:00100000:0.0:1784184899.051767:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:0.0:1784184899.051777:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8133:x1870853239220096:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784184899.052071:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8133:x1870853239220096:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 294us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184899.052079:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:3.0:1784184899.066620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184899.066737:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220224 00000100:00100000:1.0:1784184899.066747:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220224 00000100:00100000:1.0:1784184899.066823:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:1.0:1784184899.066834:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8133:x1870853239220224:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784184899.067125:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8133:x1870853239220224:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 292us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.067134:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:3.0:1784184899.078621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184899.083876:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220352 00000100:00100000:3.0:1784184899.083899:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220352 00000100:00100000:3.0:1784184899.083992:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 217 00010000:00010000:0.0:1784184899.084015:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184899.084620:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+11:8129:x1870853239220352:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784184899.084912:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184899.084940:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164b600/0x63160f6fbe8b004d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186dae expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184899.084984:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164b600/0x63160f6fbe8b004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186dae expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184899.084997:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164b600/0x63160f6fbe8b004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186dae expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184899.086131:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b600, rc 0) 00000100:00100000:3.0:1784184899.086826:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:8129:x1870853239220352:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 2817us (8215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184899.086861:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:2.0:1784184899.097752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184899.107595:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220480 00000100:00100000:0.0:1784184899.108362:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220480 00000100:00100000:0.0:1784184899.109106:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:0.0:1784184899.109124:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:8129:x1870853239220480:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784184899.109172:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784184899.109206:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784184899.109211:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784184899.109215:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784184899.109218:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1784184899.117283:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:8129:x1870853239220480:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 8145us (19528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184899.117305:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:3.0:1784184899.136485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184899.136930:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220608 00000100:00100000:1.0:1784184899.136944:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220608 00000100:00100000:1.0:1784184899.137031:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:1.0:1784184899.137045:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:8129:x1870853239220608:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784184899.137069:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184899.137096:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186db5 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184899.137137:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184899.137162:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184899.137173:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f80031200, rc 0) 00000100:00100000:1.0:1784184899.137466:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8129:x1870853239220608:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 422us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.137475:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:2.0:1784184899.151403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184899.151593:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220736 00000100:00100000:0.0:1784184899.151607:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220736 00000100:00100000:0.0:1784184899.151702:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:0.0:1784184899.151720:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8129:x1870853239220736:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784184899.152481:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8129:x1870853239220736:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 765us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184899.152493:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:3.0:1784184899.160819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184899.175154:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220864 00000100:00100000:1.0:1784184899.175177:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220864 00000100:00100000:1.0:1784184899.175308:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:1.0:1784184899.175323:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8129:x1870853239220864:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784184899.175699:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8129:x1870853239220864:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 378us (14895us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.175708:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:3.0:1784184899.186424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184899.186678:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239220992 00000100:00100000:0.0:1784184899.186691:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239220992 00000100:00100000:0.0:1784184899.186766:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 222 00000100:00100000:0.0:1784184899.186779:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8136:x1870853239220992:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784184899.187126:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8136:x1870853239220992:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 348us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184899.187135:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 222 00000100:00100000:2.0:1784184899.203583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184899.203711:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239221120 00000100:00100000:3.0:1784184899.203734:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239221120 00000100:00100000:3.0:1784184899.203809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:3.0:1784184899.203822:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8136:x1870853239221120:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784184899.204174:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:8136:x1870853239221120:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 354us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184899.204184:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:2.0:1784184899.210947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184899.211001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184899.211122:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239221248 00000100:00100000:1.0:1784184899.211135:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239221248 00000100:00100000:1.0:1784184899.211186:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239221632 00000100:00100000:1.0:1784184899.211189:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239221632 00000100:00100000:1.0:1784184899.211254:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:1.0:1784184899.211268:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239221632:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184899.211402:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239221632:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 136us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.211413:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:1.0:1784184899.211447:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1784184899.211452:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1870853239221248:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784184899.211480:0:7503:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a05f5c13-5ab9-4aef-b8cc-20aa74029adb@192.168.201.29@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:1.0:1784184899.211528:0:7503:0:(genops.c:1406:class_connect()) connect: client a05f5c13-5ab9-4aef-b8cc-20aa74029adb, cookie 0x63160f6fbe8b005b 00000004:00100000:1.0:1784184899.211572:0:7503:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784184899.212269:0:7503:0:(import.c:65:import_set_state_nolock()) ffff9b5f872ac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784184899.212321:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2352:x1870853239221248:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 866us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.212367:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:0.0:1784184899.212539:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184899.227815:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184899.227937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184899.229199:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239221376 00000100:00100000:2.0:1784184899.229217:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239221376 00000100:00100000:2.0:1784184899.229516:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239221504 00000100:00100000:2.0:1784184899.229521:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239221504 00000100:00100000:2.0:1784184899.229555:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1784184899.229587:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+7:0:x1870853239221376:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784184899.229661:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784184899.229782:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+7:0:x1870853239221376:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 197us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184899.229790:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1784184899.229815:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1784184899.229822:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:8129:x1870853239221504:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784184899.229834:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784184899.229858:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:8129:x1870853239221504:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 36us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184899.229865:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1784184899.236497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184899.236638:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239221760 00000100:00100000:3.0:1784184899.236652:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239221760 00000100:00100000:3.0:1784184899.236733:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1784184899.236744:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:8129:x1870853239221760:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784184899.236869:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:8129:x1870853239221760:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 127us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184899.236878:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1784184899.239172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184899.239224:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184899.239276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184899.239562:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222144 00000100:00100000:3.0:1784184899.239576:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222144 00000100:00100000:3.0:1784184899.239659:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1784184899.239671:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:8129:x1870853239222144:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784184899.240076:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784184899.240282:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:8129:x1870853239222144:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 611us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184899.240304:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1784184899.240751:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239221888 00000100:00100000:1.0:1784184899.240760:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239221888 00000100:00100000:1.0:1784184899.240804:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222016 00000100:00100000:1.0:1784184899.240808:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222016 00000100:00100000:1.0:1784184899.240821:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1784184899.240828:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239221888:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784184899.240858:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a05f5c13-5ab9-4aef-b8cc-20aa74029adb@192.168.201.29@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:1.0:1784184899.240896:0:6589:0:(genops.c:1406:class_connect()) connect: client a05f5c13-5ab9-4aef-b8cc-20aa74029adb, cookie 0x63160f6fbe8b0062 00002000:00100000:1.0:1784184899.240911:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a05f5c13-5ab9-4aef-b8cc-20aa74029adb/ffff9b5f872ad000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784184899.240942:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784184899.241193:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784184899.241232:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5f872a9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784184899.241394:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2352:x1870853239221888:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 564us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.241402:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1784184899.241422:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1784184899.241428:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239222016:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784184899.241446:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a05f5c13-5ab9-4aef-b8cc-20aa74029adb@192.168.201.29@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:1.0:1784184899.241463:0:6589:0:(genops.c:1406:class_connect()) connect: client a05f5c13-5ab9-4aef-b8cc-20aa74029adb, cookie 0x63160f6fbe8b0069 00002000:00100000:1.0:1784184899.241470:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a05f5c13-5ab9-4aef-b8cc-20aa74029adb/ffff9b5f872af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784184899.241478:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784184899.241618:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784184899.241646:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5f872ae800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784184899.241671:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2352:x1870853239222016:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 242us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184899.241679:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00080000:0.0:1784184899.244415:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184899.787967:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265470336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184899.788068:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184899.788363:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470336 00000100:00100000:0.0:1784184899.788374:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470336 00000100:00100000:0.0:1784184899.788457:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784184899.788469:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265470336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184899.788499:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184899.788563:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265470336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184899.788572:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1784184899.788671:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83366a00 x1870853265470336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184899.788692:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265470336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184900.106539:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784184900.416967:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00000001:00100000:2.0:1784184900.417424:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00010000:00010000:2.0:1784184901.131744:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784184901.379443:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00010000:00010000:2.0:1784184902.158648:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184903.179935:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184903.371152:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265470464:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.371229:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184903.371284:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265470976:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.371312:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184903.371360:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784184903.371366:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265470592:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.371389:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184903.371405:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265471104:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.371450:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184903.371480:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265470720:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.371503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184903.371519:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184903.371525:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265470848:0@lo:400:kworker.0 00000100:00100000:1.0:1784184903.371658:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470464 00000100:00100000:1.0:1784184903.371677:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470464 00000100:00100000:1.0:1784184903.371717:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784184903.371725:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265470464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184903.371776:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265470464:12345-0@lo:400:kworker.0 Request processed in 51us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184903.371783:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784184903.371827:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265471104 00000100:00100000:1.0:1784184903.371831:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265471104 00000100:00100000:1.0:1784184903.371865:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784184903.371871:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265471104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184903.372409:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265471104:12345-0@lo:400:kworker.0 Request processed in 536us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184903.372418:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1784184903.372438:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784184903.372473:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d2a00 x1870853265471104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184903.372487:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265471104:0@lo:400:kworker.0 00000100:00100000:1.0:1784184903.372496:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265470464:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.372682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184903.372717:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470976 00000100:00100000:0.0:1784184903.372722:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470976 00000100:00100000:0.0:1784184903.372758:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470592 00000100:00100000:0.0:1784184903.372761:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470592 00000100:00100000:0.0:1784184903.372783:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470720 00000100:00100000:0.0:1784184903.372786:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470720 00000100:00100000:0.0:1784184903.372812:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784184903.372819:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265470976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.372861:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265470976:12345-0@lo:400:kworker.0 Request processed in 43us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184903.372868:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784184903.372882:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784184903.372887:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265470592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.373226:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265470592:12345-0@lo:400:kworker.0 Request processed in 337us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184903.373234:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784184903.373248:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784184903.373254:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265470720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.373297:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265470720:12345-0@lo:400:kworker.0 Request processed in 43us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184903.373303:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784184903.373322:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184903.373367:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265470592:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.373378:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265470976:0@lo:400:kworker.0 00000100:00100000:3.0:1784184903.373755:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265470848 00000100:00100000:3.0:1784184903.373760:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265470848 00000100:00100000:0.0:1784184903.373790:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784184903.373810:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784184903.373819:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265470848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184903.373859:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265470848:12345-0@lo:400:kworker.0 Request processed in 43us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184903.373865:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784184903.373876:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265471232:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784184903.373892:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784184903.374030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184903.374230:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265471232 00000100:00100000:3.0:1784184903.374235:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265471232 00000100:00100000:3.0:1784184903.374268:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784184903.374274:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265471232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184903.374301:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184903.374363:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265471232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184903.374370:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1784184903.374397:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b4a80 x1870853265471232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184903.374413:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265471232:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784184903.374481:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83364700 x1870853265470848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184903.374509:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265470848:0@lo:400:kworker.0 00000100:00100000:0.0:1784184903.374525:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265470720:0@lo:400:kworker.0 00010000:00010000:2.0:1784184904.204401:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184904.279783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184904.279848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184904.279883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184904.279910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184904.279932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184904.280061:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222528 00000100:00100000:2.0:1784184904.280071:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222528 00000100:00100000:2.0:1784184904.280133:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222400 00000100:00100000:2.0:1784184904.280142:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222400 00000100:00100000:2.0:1784184904.280188:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1784184904.280198:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239222528:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184904.280273:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239222528:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184904.280281:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1784184904.280298:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1784184904.280304:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239222400:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184904.280363:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239222400:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184904.280386:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:0.0:1784184904.280411:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222272 00000100:00100000:0.0:1784184904.280417:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222272 00000100:00100000:0.0:1784184904.280467:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:0.0:1784184904.280475:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239222272:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184904.280504:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239222272:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184904.280511:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:3.0:1784184904.280727:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222784 00000100:00100000:3.0:1784184904.280803:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222784 00000100:00100000:3.0:1784184904.280845:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222656 00000100:00100000:3.0:1784184904.280848:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222656 00000100:00100000:3.0:1784184904.280865:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1784184904.280874:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239222784:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184904.280888:0:6589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784184904.280898:0:6589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784184904.280914:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239222784:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 41us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184904.280921:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1784184904.280936:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:2.0:1784184904.280942:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784184904.280943:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239222656:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184904.280971:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239222656:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184904.280979:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00080000:1.0:1784184904.281109:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784184904.281115:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784184904.281118:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184904.907300:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184904.907326:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265471360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184904.907414:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184904.907602:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265471360 00000100:00100000:0.0:1784184904.907610:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265471360 00000100:00100000:0.0:1784184904.907660:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784184904.907670:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265471360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184904.907705:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184904.907757:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265471360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184904.907764:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1784184904.907873:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13a8000 x1870853265471360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184904.907891:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265471360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184905.228001:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184906.251201:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784184906.827985:0:10176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1784184907.274629:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184908.305447:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184908.490854:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265471488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184908.490938:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184908.491008:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184908.491017:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265471616:0@lo:400:kworker.0 00000100:00100000:1.0:1784184908.491048:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265471744:0@lo:400:kworker.0 00000100:00100000:0.0:1784184908.491056:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184908.491094:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184908.491101:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265472000:0@lo:400:kworker.0 00000100:00100000:1.0:1784184908.491123:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184908.491131:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265471872:0@lo:400:kworker.0 00000100:00100000:0.0:1784184908.491135:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184908.491161:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184908.491187:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184908.491196:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265472128:0@lo:400:kworker.0 00000100:00100000:1.0:1784184908.491204:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265471744 00000100:00100000:1.0:1784184908.491212:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265471744 00000100:00100000:0.0:1784184908.491226:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184908.491259:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265471872 00000100:00100000:0.0:1784184908.491262:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265471616 00000100:00100000:1.0:1784184908.491263:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265471872 00000100:00100000:0.0:1784184908.491268:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265471616 00000100:00100000:1.0:1784184908.491295:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472128 00000100:00100000:1.0:1784184908.491299:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472128 00000100:00100000:0.0:1784184908.491308:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784184908.491320:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265471616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184908.491324:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784184908.491389:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265471616:12345-0@lo:400:kworker.0 Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184908.491397:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784184908.491479:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472000 00000100:00100000:0.0:1784184908.491482:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472000 00000100:00100000:0.0:1784184908.491513:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784184908.491520:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265472000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184908.491553:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265472000:12345-0@lo:400:kworker.0 Request processed in 34us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184908.491559:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784184908.491577:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784184908.491584:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265471872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184908.491748:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265471744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184908.491834:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265471488 00000100:00100000:3.0:1784184908.491838:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265471488 00000100:00100000:3.0:1784184908.491874:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784184908.491882:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265471488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184908.491911:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184908.491947:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265471488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184908.491955:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784184908.491969:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265471872:12345-0@lo:400:kworker.0 Request processed in 383us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184908.491978:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784184908.491996:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784184908.492002:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265472128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184908.492028:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265472128:12345-0@lo:400:kworker.0 Request processed in 27us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184908.492042:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784184908.492084:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265472128:0@lo:400:kworker.0 00010000:00080000:0.0:1784184908.492098:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbe7b80 x1870853265472000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184908.492109:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265472000:0@lo:400:kworker.0 00000100:00100000:0.0:1784184908.492117:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265471616:0@lo:400:kworker.0 00010000:00080000:0.0:1784184908.492127:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b4a80 x1870853265471488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184908.492139:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265471488:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784184908.493913:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784184908.493922:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784184908.493925:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184908.499702:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265471872:0@lo:400:kworker.0 00000100:00100000:1.0:1784184908.504129:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265471744:12345-0@lo:400:kworker.0 Request processed in 12376us (13026us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184908.504160:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784184908.505009:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265471744:0@lo:400:kworker.0 00010000:00010000:2.0:1784184909.322544:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184909.393402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184909.393683:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223040 00000100:00100000:1.0:1784184909.393694:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223040 00000100:00100000:1.0:1784184909.393767:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:1.0:1784184909.393777:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239223040:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184909.393849:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239223040:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184909.393857:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00080000:3.0:1784184909.394991:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184909.397583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184909.397689:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223296 00000100:00100000:0.0:1784184909.397699:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223296 00000100:00100000:0.0:1784184909.397771:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1784184909.397782:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239223296:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184909.397863:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239223296:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184909.397870:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00080000:3.0:1784184909.397925:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184909.410463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184909.410510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184909.410554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184909.410655:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223168 00000100:00100000:2.0:1784184909.410675:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239222912 00000100:00100000:3.0:1784184909.410676:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223168 00000100:00100000:2.0:1784184909.410693:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239222912 00000100:00100000:2.0:1784184909.410753:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:2.0:1784184909.410780:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239222912:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184909.410796:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1784184909.410809:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239223168:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184909.410863:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239222912:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 85us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184909.410872:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:3.0:1784184909.410892:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239223168:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 82us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184909.410916:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00080000:1.0:1784184909.411098:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184909.411191:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223424 00000100:00100000:0.0:1784184909.411197:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223424 00000100:00100000:0.0:1784184909.411262:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1784184909.411270:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239223424:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184909.411328:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239223424:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 59us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184909.411377:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00080000:1.0:1784184909.411423:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184910.027484:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784184910.027509:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265472256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184910.027580:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184910.027652:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472256 00000100:00100000:0.0:1784184910.027658:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472256 00000100:00100000:0.0:1784184910.027715:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784184910.027724:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265472256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184910.027757:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184910.027800:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265472256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184910.027807:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1784184910.027827:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184910.027856:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13aaa00 x1870853265472256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184910.027874:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265472256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184910.346650:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184911.370607:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184912.398203:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184913.418498:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184913.610614:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784184913.610650:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265472384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184913.610719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184913.610783:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472384 00000100:00100000:3.0:1784184913.610790:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472384 00000100:00100000:3.0:1784184913.610854:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784184913.610863:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265472384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184913.610895:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184913.610935:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265472384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184913.610942:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1784184913.610960:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784184913.611007:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b4700 x1870853265472384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184913.611024:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265472384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184913.622417:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265472512:0@lo:400:kworker.0 00000100:00100000:1.0:1784184913.622495:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184913.623360:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472512 00000100:00100000:3.0:1784184913.623369:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472512 00000100:00100000:3.0:1784184913.623431:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784184913.623440:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265472512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639072:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265472640:0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639163:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184913.639204:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184913.639211:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265473024:0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639246:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184913.639278:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472640 00000100:00100000:0.0:1784184913.639285:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472640 00000100:00100000:0.0:1784184913.639353:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473024 00000100:00100000:0.0:1784184913.639358:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473024 00000100:00100000:0.0:1784184913.639401:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784184913.639423:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265472640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639476:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265472640:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184913.639483:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784184913.639501:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784184913.639507:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265473024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639534:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265473024:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184913.639540:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784184913.639585:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265473024:0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639595:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265472640:0@lo:400:kworker.0 00000100:00080000:0.0:1784184913.639616:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184913.639627:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265472896:0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184913.639688:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784184913.639693:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265472768:0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184913.639736:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472896 00000100:00100000:0.0:1784184913.639740:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472896 00000100:00100000:0.0:1784184913.639773:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784184913.639780:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265472896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.639813:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265472896:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184913.639820:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784184913.641367:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265472768 00000100:00100000:0.0:1784184913.641403:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265472768 00000100:00100000:0.0:1784184913.641452:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784184913.641459:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265472768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184913.641517:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265472768:12345-0@lo:400:kworker.0 Request processed in 58us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184913.641523:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1784184913.641553:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784184913.641557:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784184913.641587:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265472768:0@lo:400:kworker.0 00010000:00080000:0.0:1784184913.641600:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13a8380 x1870853265472896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184913.641610:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265472896:0@lo:400:kworker.0 00000100:00100000:3.0:1784184913.650703:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265472512:12345-0@lo:400:kworker.0 Request processed in 27254us (28198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184913.650720:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1784184913.651725:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265472512:0@lo:400:kworker.0 00010000:00010000:1.0:1784184914.442681:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184914.514796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184914.514861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184914.514887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184914.514905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184914.514935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184914.514964:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223808 00000100:00100000:3.0:1784184914.514973:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223808 00000100:00100000:3.0:1784184914.515031:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223680 00000100:00100000:3.0:1784184914.515034:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223680 00000100:00100000:3.0:1784184914.515058:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1784184914.515068:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239223808:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184914.515141:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239223808:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 73us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184914.515147:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1784184914.515163:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:3.0:1784184914.515170:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239223680:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184914.515195:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239223680:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184914.515200:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:3.0:1784184914.515217:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224064 00000100:00100000:3.0:1784184914.515221:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224064 00000100:00100000:3.0:1784184914.515257:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223936 00000100:00100000:3.0:1784184914.515261:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223936 00000100:00100000:3.0:1784184914.515281:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:3.0:1784184914.515288:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239224064:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184914.515313:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239224064:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184914.515319:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:3.0:1784184914.515363:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1784184914.515400:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faefa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239223936:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184914.515430:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faefa4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239223936:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 60us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184914.515436:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00080000:3.0:1784184914.515596:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784184914.515600:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784184914.515602:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184914.515857:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239223552 00000100:00100000:2.0:1784184914.515862:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239223552 00000100:00100000:2.0:1784184914.515903:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:2.0:1784184914.515911:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239223552:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184914.515945:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239223552:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184914.515950:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:0.0:1784184915.148534:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265473152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184915.148605:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184915.153006:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473152 00000100:00100000:3.0:1784184915.153022:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473152 00000100:00100000:3.0:1784184915.153101:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784184915.153112:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265473152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184915.153152:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184915.153242:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265473152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (4637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184915.153250:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1784184915.153417:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184915.154830:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f982c1500 x1870853265473152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184915.154859:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265473152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184915.466473:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184916.491581:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184917.527056:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184918.538466:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184918.730615:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184918.730640:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265473280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184918.730712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184918.730837:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473280 00000100:00100000:3.0:1784184918.730846:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473280 00000100:00100000:3.0:1784184918.730910:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784184918.730921:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265473280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184918.730958:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184918.731004:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265473280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184918.731011:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1784184918.731405:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784184918.731435:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f982c1180 x1870853265473280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184918.731454:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265473280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184918.740546:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265473536:0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.740616:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184918.740667:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784184918.740674:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265473664:0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.740698:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184918.740736:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473536 00000100:00100000:1.0:1784184918.740744:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473536 00000100:00100000:1.0:1784184918.740786:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473664 00000100:00100000:1.0:1784184918.740790:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473664 00000100:00100000:1.0:1784184918.740824:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784184918.740831:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265473536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.740884:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265473536:12345-0@lo:400:kworker.0 Request processed in 53us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184918.740891:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784184918.740910:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784184918.740918:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265473664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.740944:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265473664:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184918.740950:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1784184918.740975:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184918.741002:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265473664:0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.741012:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265473536:0@lo:400:kworker.0 00000100:00100000:3.0:1784184918.741089:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265473408:0@lo:400:kworker.0 00000100:00100000:3.0:1784184918.741125:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184918.741172:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265473920:0@lo:400:kworker.0 00000100:00100000:3.0:1784184918.741195:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184918.741211:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784184918.741215:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265473792:0@lo:400:kworker.0 00000100:00100000:3.0:1784184918.741236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184918.741262:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473792 00000100:00100000:3.0:1784184918.741265:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473792 00000100:00100000:3.0:1784184918.741307:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784184918.741314:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265473792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184918.741375:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265473792:12345-0@lo:400:kworker.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184918.741382:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1784184918.741412:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbe6a00 x1870853265473792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184918.741424:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265473792:0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.741555:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473408 00000100:00100000:1.0:1784184918.741560:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473408 00000100:00100000:1.0:1784184918.741596:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784184918.741603:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265473408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.741651:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265473408:12345-0@lo:400:kworker.0 Request processed in 49us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184918.741658:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:1.0:1784184918.741682:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184918.741691:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265473920 00000100:00100000:1.0:1784184918.741695:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265473920 00000100:00100000:1.0:1784184918.741722:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784184918.741728:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265473920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.741756:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265473920:12345-0@lo:400:kworker.0 Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184918.741762:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1784184918.741778:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184918.741792:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265473408:0@lo:400:kworker.0 00000100:00100000:1.0:1784184918.741802:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265473920:0@lo:400:kworker.0 00010000:00010000:2.0:1784184919.562442:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184919.631863:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184919.631907:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184919.631928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184919.631956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184919.632029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184919.632065:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224448 00000100:00100000:3.0:1784184919.632074:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224448 00000100:00100000:3.0:1784184919.632169:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224320 00000100:00100000:3.0:1784184919.632173:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224320 00000100:00100000:3.0:1784184919.632199:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:3.0:1784184919.632208:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239224448:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184919.632301:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239224448:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 92us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184919.632321:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:3.0:1784184919.632362:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:3.0:1784184919.632369:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239224320:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184919.632394:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239224320:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184919.632401:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:3.0:1784184919.632421:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224576 00000100:00100000:3.0:1784184919.632424:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224576 00000100:00100000:3.0:1784184919.632450:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224704 00000100:00100000:3.0:1784184919.632454:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224704 00000100:00100000:3.0:1784184919.632474:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784184919.632481:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2352:x1870853239224576:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1784184919.632500:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8b0062 00000100:00080000:3.0:1784184919.632508:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5f872a9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784184919.632545:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784184919.632855:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+2:2352:x1870853239224576:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 374us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184919.632862:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784184919.632875:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1784184919.632881:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2352:x1870853239224704:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1784184919.632892:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8b0069 00000100:00080000:3.0:1784184919.632897:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5f872ae800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784184919.632924:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784184919.633107:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+2:2352:x1870853239224704:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 225us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184919.633125:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00080000:3.0:1784184919.633148:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784184919.633151:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784184919.633153:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784184919.633267:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184919.633273:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184919.633940:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224192 00000100:00100000:2.0:1784184919.633947:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224192 00000100:00100000:2.0:1784184919.633989:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:2.0:1784184919.633997:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239224192:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184919.634050:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239224192:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 54us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184919.634056:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:1.0:1784184920.268739:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265474048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184920.268838:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184920.269371:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474048 00000100:00100000:2.0:1784184920.269394:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474048 00000100:00100000:2.0:1784184920.269475:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784184920.269487:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265474048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784184920.269537:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784184920.269692:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784184920.269848:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265474048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 354us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184920.269859:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1784184920.272045:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb89c0700 x1870853265474048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184920.272085:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265474048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184920.586586:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784184920.891400:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00000020:00000080:0.0:1784184920.891415:0:7506:0:(genops.c:906:class_export_put()) final put ffff9b5f872af000/a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00000020:00000080:2.0:1784184920.891631:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f872af000/a05f5c13-5ab9-4aef-b8cc-20aa74029adb for lustre-OST0001 00000020:00000080:2.0:1784184920.891712:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f872ae800 for lustre-OST0001 00010000:00010000:0.0:1784184921.614596:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784184921.892711:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00000020:00000080:3.0:1784184921.892721:0:6613:0:(genops.c:906:class_export_put()) final put ffff9b5f872ad000/a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00000020:00000080:2.0:1784184921.892814:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f872ad000/a05f5c13-5ab9-4aef-b8cc-20aa74029adb for lustre-OST0000 00000020:00000080:2.0:1784184921.892995:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f872a9800 for lustre-OST0000 00010000:00010000:3.0:1784184922.643802:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184923.658533:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184923.851601:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265474176:0@lo:400:kworker.0 00000100:00100000:2.0:1784184923.851716:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184923.851846:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265474304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184923.851885:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184923.852128:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265474560:0@lo:400:kworker.0 00000100:00100000:0.0:1784184923.852162:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184923.852202:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265474432:0@lo:400:kworker.0 00000100:00100000:0.0:1784184923.852250:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184923.852592:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474176 00000100:00100000:3.0:1784184923.852603:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474176 00000100:00100000:3.0:1784184923.852669:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784184923.852681:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265474176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184923.852745:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265474176:12345-0@lo:400:kworker.0 Request processed in 67us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184923.852752:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784184923.858018:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474560 00000100:00100000:2.0:1784184923.858041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474560 00000100:00100000:2.0:1784184923.858133:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474432 00000100:00100000:2.0:1784184923.858137:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474432 00000100:00100000:2.0:1784184923.858165:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784184923.858175:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265474560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184923.858306:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265474560:12345-0@lo:400:kworker.0 Request processed in 132us (6143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184923.858315:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784184923.858358:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784184923.858364:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265474432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184923.858398:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265474432:12345-0@lo:400:kworker.0 Request processed in 34us (6148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184923.858419:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784184923.858442:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474304 00000100:00100000:2.0:1784184923.858445:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474304 00000100:00100000:2.0:1784184923.858473:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784184923.858478:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265474304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184923.858513:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184923.858764:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265474304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (6878us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184923.858771:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1784184923.858790:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784184923.858795:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184923.858849:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265474560:0@lo:400:kworker.0 00000100:00100000:2.0:1784184923.858903:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265474432:0@lo:400:kworker.0 00000100:00100000:2.0:1784184923.858950:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265474176:0@lo:400:kworker.0 00010000:00080000:3.0:1784184923.859033:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13a9f80 x1870853265474304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184923.859116:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265474304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184923.863317:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265474688:0@lo:400:kworker.0 00000100:00100000:1.0:1784184923.863427:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184923.863522:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474688 00000100:00100000:3.0:1784184923.863533:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474688 00000100:00100000:1.0:1784184923.863590:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184923.863600:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265474816:0@lo:400:kworker.0 00000100:00100000:3.0:1784184923.863610:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784184923.863621:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265474688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184923.863632:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184923.863672:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474816 00000100:00100000:1.0:1784184923.863676:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474816 00000100:00100000:1.0:1784184923.863713:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784184923.863720:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265474816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184923.863758:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265474816:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184923.863766:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784184923.863812:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265474816:0@lo:400:kworker.0 00000100:00100000:3.0:1784184923.864294:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265474688:12345-0@lo:400:kworker.0 Request processed in 675us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184923.864301:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1784184923.864357:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784184923.864363:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784184923.864772:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbe6680 x1870853265474688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184923.864787:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265474688:0@lo:400:kworker.0 00010000:00010000:0.0:1784184924.682853:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184924.750758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184924.750800:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184924.750850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184924.750902:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225088 00000100:00100000:3.0:1784184924.750912:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225088 00000100:00100000:3.0:1784184924.750983:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224960 00000100:00100000:3.0:1784184924.750986:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224960 00000100:00100000:3.0:1784184924.751007:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1784184924.751016:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239225088:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184924.751428:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239225088:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 412us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184924.751437:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1784184924.751532:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:3.0:1784184924.751541:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239224960:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184924.751629:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239224960:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 89us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184924.751636:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00080000:3.0:1784184924.751655:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184924.752575:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239224832 00000100:00100000:2.0:1784184924.752584:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239224832 00000100:00100000:2.0:1784184924.752638:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:2.0:1784184924.752647:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239224832:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184924.752693:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239224832:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184924.752699:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:0.0:1784184925.386785:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184925.386809:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265474944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184925.386881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184925.389744:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265474944 00000100:00100000:3.0:1784184925.389758:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265474944 00000100:00100000:3.0:1784184925.389848:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784184925.389859:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265474944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184925.389897:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184925.389999:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265474944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (3117us total) trans 0 rc 0/0 00000100:00080000:0.0:1784184925.390403:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784184925.390455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7123b80 x1870853265474944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184925.390478:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265474944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784184925.390479:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1784184925.706523:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784184926.171750:0:10879:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1784184926.730509:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184927.761350:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184928.778882:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184928.971647:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265475200:0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.971724:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184928.971859:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265475712:0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.971888:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184928.971921:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784184928.971926:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265475072:0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.971952:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184928.971973:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265475584:0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.971992:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184928.972018:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265475328:0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.972057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184928.972079:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184928.972085:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265475456:0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.972109:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184928.972161:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265475200 00000100:00100000:1.0:1784184928.972169:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265475200 00000100:00100000:1.0:1784184928.972214:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265475584 00000100:00100000:1.0:1784184928.972217:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265475584 00000100:00100000:1.0:1784184928.972239:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265475328 00000100:00100000:1.0:1784184928.972241:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265475328 00000100:00100000:1.0:1784184928.972258:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784184928.972266:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265475200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.972323:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265475200:12345-0@lo:400:kworker.0 Request processed in 57us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184928.972356:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784184928.972374:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784184928.972381:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265475584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.972899:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265475584:12345-0@lo:400:kworker.0 Request processed in 518us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184928.972906:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784184928.972920:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784184928.972927:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265475328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.972951:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265475328:12345-0@lo:400:kworker.0 Request processed in 26us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184928.972956:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784184928.972975:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265475712 00000100:00100000:1.0:1784184928.972978:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265475712 00000100:00100000:1.0:1784184928.973012:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265475456 00000100:00100000:1.0:1784184928.973015:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265475456 00000100:00100000:1.0:1784184928.973042:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784184928.973049:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265475712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.973079:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265475712:12345-0@lo:400:kworker.0 Request processed in 31us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184928.973094:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784184928.973106:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784184928.973112:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.973151:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265475456:12345-0@lo:400:kworker.0 Request processed in 39us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184928.973157:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784184928.973175:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265475072 00000100:00100000:1.0:1784184928.973179:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265475072 00000100:00100000:1.0:1784184928.973203:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784184928.973209:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265475072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.973240:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265475072:12345-0@lo:400:kworker.0 Request processed in 31us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184928.973246:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:1.0:1784184928.973285:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784184928.973289:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784184928.973291:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184928.973302:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184928.973313:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265475840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184928.973365:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784184928.974511:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d1c00 x1870853265475456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184928.974526:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265475456:0@lo:400:kworker.0 00000100:00100000:0.0:1784184928.974538:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265475328:0@lo:400:kworker.0 00000100:00100000:0.0:1784184928.974570:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265475072:0@lo:400:kworker.0 00000100:00100000:0.0:1784184928.974580:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265475584:0@lo:400:kworker.0 00000100:00100000:0.0:1784184928.974590:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265475200:0@lo:400:kworker.0 00010000:00080000:0.0:1784184928.974600:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5e819d2300 x1870853265475712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184928.974609:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265475712:0@lo:400:kworker.0 00000100:00100000:1.0:1784184928.975298:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265475840 00000100:00100000:1.0:1784184928.975306:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265475840 00000100:00100000:1.0:1784184928.975382:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784184928.975559:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265475840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784184928.975598:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184928.975677:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265475840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (2311us total) trans 0 rc 0/0 00010000:00080000:0.0:1784184928.975783:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13a8e00 x1870853265475840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184928.975807:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265475840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184928.986245:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1784184929.802440:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184929.869661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184929.869705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184929.869739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184929.869833:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225216 00000100:00100000:0.0:1784184929.869843:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225216 00000100:00100000:0.0:1784184929.869901:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 235 00000100:00100000:0.0:1784184929.869911:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239225216:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184929.869979:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239225216:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184929.869987:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 235 00000100:00100000:2.0:1784184929.870225:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225344 00000100:00100000:2.0:1784184929.870242:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225344 00000100:00100000:2.0:1784184929.870286:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225472 00000100:00100000:2.0:1784184929.870289:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225472 00000100:00100000:2.0:1784184929.870310:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:2.0:1784184929.870317:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239225344:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184929.870382:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239225344:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 65us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184929.870389:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:2.0:1784184929.870402:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:2.0:1784184929.870408:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239225472:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184929.870433:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239225472:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184929.870439:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00080000:0.0:1784184929.870652:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1784184930.053759:0:11026:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd63ab2ee0 20000000:00000080:1.0:1784184930.053777:0:11026:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b5fbf919400 uarg=0000000000000000 20000000:01000000:1.0:1784184930.053813:0:11026:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784184930.053818:0:11026:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784184930.053823:0:11026:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784184930.054916:0:11027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1784184930.055068:0:11026:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784184930.067855:0:11026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784184930.068201:0:11026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068221:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068230:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068236:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068246:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068252:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068259:0:11026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068308:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.068889:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 12 pid: 5786 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.068906:0:11026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265475968:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784184930.069011:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.069019:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 12 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.069028:0:11026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476096:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784184930.069061:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.069069:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 18 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.069079:0:11026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476224:0@lo:104: 00000100:00100000:1.0:1784184930.069129:0:11026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784184930.069175:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.069183:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 18 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.069192:0:11026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476352:0@lo:104: 00000100:00100000:1.0:1784184930.069213:0:11026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784184930.069256:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184930.069264:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 18 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.069273:0:11026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476480:0@lo:104: 00000100:00100000:1.0:1784184930.069293:0:11026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184930.069304:0:11026:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf900 going to sleep for 11 seconds 00000100:00100000:0.0:1784184930.069407:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265476224 00000100:00100000:0.0:1784184930.069416:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265476224 00000100:00100000:0.0:1784184930.069452:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265476352 00000100:00100000:0.0:1784184930.069454:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265476352 00000100:00100000:0.0:1784184930.069462:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265476480 00000100:00100000:0.0:1784184930.069464:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265476480 00000100:00100000:0.0:1784184930.069476:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784184930.069484:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:11026:x1870853265476224:12345-0@lo:104: 00010000:00010000:0.0:1784184930.069496:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069558:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784184930.069564:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:11026:x1870853265476224:12345-0@lo:104: Request processed in 82us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184930.069581:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784184930.069598:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784184930.069604:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:11026:x1870853265476352:12345-0@lo:104: 00010000:00010000:0.0:1784184930.069612:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069697:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784184930.069703:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:11026:x1870853265476352:12345-0@lo:104: Request processed in 99us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184930.069709:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784184930.069722:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784184930.069802:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:11026:x1870853265476480:12345-0@lo:104: 00010000:00010000:0.0:1784184930.069809:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069849:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784184930.069854:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:11026:x1870853265476480:12345-0@lo:104: Request processed in 127us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184930.069861:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784184930.069877:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784184930.069883:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069889:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f80031a00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784184930.069893:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069912:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184930.069918:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184930.069924:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784184930.069952:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069959:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784184930.069977:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069983:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f80031a00/0x63160f6fbe8b0031 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b0038 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.069995:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784184930.069998:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070004:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784184930.070007:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070013:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184930.070019:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184930.070029:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784184930.070043:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070049:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784184930.070063:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070069:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c600/0x63160f6fbe8b0023 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b002a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070079:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784184930.070082:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070087:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784184930.070089:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070095:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784184930.070101:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184930.070106:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784184930.070129:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070135:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784184930.070148:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070154:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b001c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070167:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184930.070169:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184930.070170:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184930.070177:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184930.070188:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265476608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784184930.070223:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184930.070264:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265476864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784184930.070286:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184930.070300:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184930.070305:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265476736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784184930.070323:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184930.070375:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265476608 00000100:00100000:0.0:1784184930.070380:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265476608 00010000:00010000:0.0:1784184930.070399:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 19 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184930.070419:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265476864 00000100:00100000:0.0:1784184930.070421:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265476864 00010000:00010000:0.0:1784184930.070430:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 20 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184930.070440:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265476736 00000100:00100000:0.0:1784184930.070442:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265476736 00010000:00010000:0.0:1784184930.070451:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 21 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184930.070472:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784184930.070478:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+21:3314:x1870853265476608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784184930.070488:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184930.070493:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 21 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070503:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 21 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070519:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184930.070547:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+21:3314:x1870853265476608:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184930.070553:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784184930.070590:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784184930.070596:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+20:3316:x1870853265476864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784184930.070604:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184930.070608:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 20 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070616:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 20 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070626:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184930.070650:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+20:3316:x1870853265476864:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184930.070656:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784184930.070669:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784184930.070681:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265476736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784184930.070690:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184930.070695:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 19 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070703:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 19 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184930.070713:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784184930.070883:0:11026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970a00/0x63160f6fbe8b0038 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b0031 expref: 19 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.070894:0:11026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476224:0@lo:104: 00010000:00010000:1.0:1784184930.070904:0:11026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b002a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b0023 expref: 18 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.070912:0:11026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476352:0@lo:104: 00010000:00010000:1.0:1784184930.070920:0:11026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b001c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b0015 expref: 17 pid: 5784 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.070927:0:11026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476480:0@lo:104: 00010000:00010000:2.0:1784184930.071653:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184930.071805:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3316:x1870853265476736:12345-0@lo:103:ldlm_bl.0 Request processed in 1123us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184930.071815:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784184930.071860:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265476608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784184930.071890:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265476736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784184930.071897:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265476864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784184930.074945:0:11026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265476096:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784184930.077630:0:11026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1870853265475968:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784184930.077671:0:11026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184930.084297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184930.084385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184930.084535:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225600 00000100:00100000:2.0:1784184930.084545:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225600 00010000:00010000:2.0:1784184930.084582:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 13 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184930.084610:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225728 00000100:00100000:2.0:1784184930.084613:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225728 00010000:00010000:2.0:1784184930.084622:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 14 pid: 5786 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184930.084650:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1784184930.084658:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+14:2355:x1870853239225600:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184930.084673:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184930.084691:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 14 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084702:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 14 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084718:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b003f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186d7d expref: 14 pid: 5787 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084744:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184930.084790:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239225600:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 133us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184930.084797:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1784184930.084813:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1784184930.084819:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:2355:x1870853239225728:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184930.084826:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184930.084830:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 12 pid: 5786 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084840:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 12 pid: 5786 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084849:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f80031200/0x63160f6fbe8b0054 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186db5 expref: 12 pid: 5786 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084860:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084868:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084888:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084895:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084902:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084908:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084914:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784184930.084918:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084926:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084940:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.084948:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184930.084965:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:2355:x1870853239225728:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 146us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184930.084970:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00010000:00010000:2.0:1784184930.086361:0:11026:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.086383:0:11026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184930.086400:0:11026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5fbfbd8400/0x63160f6fbe8b0070 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184930.508864:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184930.508890:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265476992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184930.508975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184930.509024:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265476992 00000100:00100000:3.0:1784184930.509031:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265476992 00000100:00080000:1.0:1784184930.509060:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784184930.509079:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784184930.509088:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265476992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184930.509131:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184930.509187:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265476992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184930.509194:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1784184930.509275:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7121500 x1870853265476992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184930.509294:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265476992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784184930.828045:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784184931.404377:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784184931.404385:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbfbf1800 from 7 10000000:01000000:1.0:1784184931.404390:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784184931.404439:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.404451:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.404462:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184931.404490:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.404557:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184931.404610:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184931.404740:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265477120 00000100:00100000:3.0:1784184931.404748:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265477120 00000100:00100000:3.0:1784184931.404803:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784184931.404813:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265477120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184931.404837:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184931.404851:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0077 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.404874:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.404884:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.404910:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b000, rc 0) 00000100:00100000:3.0:1784184931.404956:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265477120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184931.404963:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784184931.405650:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784184931.405669:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.405678:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184931.405734:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.405772:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184931.405799:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184931.405946:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265477248 00000100:00100000:3.0:1784184931.405951:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265477248 00000100:00100000:3.0:1784184931.405986:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784184931.405994:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265477248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184931.406255:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265477248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184931.406263:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784184931.407128:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.407167:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.407212:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184931.407241:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184931.407303:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265477376 00000100:00100000:3.0:1784184931.407308:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265477376 00000100:00100000:3.0:1784184931.407363:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784184931.407371:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265477376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184931.407525:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265477376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184931.407532:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1784184931.407612:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784184931.408836:0:11046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784184931.409183:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784184931.409205:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784184931.409217:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184931.409227:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184931.409238:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784184931.409240:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fc0d20000 from 7 10000000:01000000:0.0:1784184931.409244:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784184931.409280:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184931.409298:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184931.409308:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184931.409330:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784184931.409418:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184931.409465:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af540 going to sleep for 11 seconds 00000100:00100000:1.0:1784184931.411785:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265477504 00000100:00100000:1.0:1784184931.411799:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265477504 00000100:00100000:1.0:1784184931.411977:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784184931.411989:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265477504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784184931.412007:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184931.412024:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0085 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.412051:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.412062:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.412071:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8200, rc 0) 00000100:00100000:1.0:1784184931.412154:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265477504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184931.412165:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784184931.412356:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184931.412374:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184931.412383:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184931.412454:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9342a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184931.412488:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184931.412518:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165c180 going to sleep for 11 seconds 00000100:00100000:2.0:1784184931.412532:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265477632 00000100:00100000:2.0:1784184931.412536:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265477632 00000100:00100000:2.0:1784184931.412563:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784184931.412570:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265477632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184931.412811:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265477632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184931.412829:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784184931.412860:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9342a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184931.412888:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9342a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784184931.412926:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184931.412950:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165c180 going to sleep for 11 seconds 00000100:00100000:0.0:1784184931.412991:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265477760 00000100:00100000:0.0:1784184931.412996:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265477760 00000100:00100000:0.0:1784184931.413032:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784184931.413040:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265477760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184931.413201:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265477760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184931.413208:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784184931.413247:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9342a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784184931.414115:0:11048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784184931.414921:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784184931.414954:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784184931.414964:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.414976:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184931.414986:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784184931.414989:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5f85958000 from 7 10000000:01000000:1.0:1784184931.414991:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784184931.415022:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.415030:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184931.415038:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184931.415062:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.415123:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184931.415162:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf540 going to sleep for 11 seconds 00000100:00100000:0.0:1784184931.415250:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265477888 00000100:00100000:0.0:1784184931.415256:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265477888 00000100:00100000:0.0:1784184931.415301:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784184931.415310:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265477888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784184931.415322:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184931.415350:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0093 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184931.415384:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184931.415395:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184931.415404:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c600, rc 0) 00000100:00100000:0.0:1784184931.415534:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265477888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184931.415541:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784184931.415624:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265477888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184931.415656:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184931.415666:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184931.415714:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9341c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265478016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184931.415740:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184931.415764:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784184931.415849:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478016 00000100:00100000:0.0:1784184931.415854:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478016 00000100:00100000:0.0:1784184931.415927:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784184931.415935:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265478016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784184931.416187:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265478016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184931.416194:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784184931.419787:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9341c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265478016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784184931.419849:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265478144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184931.419919:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184931.423004:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902afb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184931.424760:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478144 00000100:00100000:1.0:1784184931.424774:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478144 00000100:00100000:1.0:1784184931.424847:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784184931.424858:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265478144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.425095:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265478144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (5166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184931.425103:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784184931.426905:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265478144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784184931.429018:0:11049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784184931.433380:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784184931.433416:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784184931.433426:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.433440:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184931.534399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184931.534501:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225856 00000100:00100000:3.0:1784184931.534512:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225856 00000100:00100000:3.0:1784184931.534581:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 245 00000100:00100000:3.0:1784184931.534592:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+11:5573:x1870853239225856:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184931.534609:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184931.534629:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186ddf expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.534669:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.534682:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.534690:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a600, rc 0) 00000100:00100000:3.0:1784184931.534749:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239225856:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 159us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184931.534756:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 245 00000100:00100000:2.0:1784184931.537863:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184931.538188:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239225984 00000100:00100000:3.0:1784184931.538199:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239225984 00000100:00100000:3.0:1784184931.538256:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 246 00000100:00100000:3.0:1784184931.538266:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239225984:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184931.539751:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239225984:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 1480us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184931.539763:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 246 00000100:00100000:3.0:1784184931.549460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184931.549614:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239226112 00000100:00100000:1.0:1784184931.549625:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239226112 00000100:00100000:1.0:1784184931.549687:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 247 00000100:00100000:1.0:1784184931.549697:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239226112:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.549889:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239226112:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 193us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184931.549897:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 247 00000100:00100000:2.0:1784184931.582668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184931.585495:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239226240 00000100:00100000:3.0:1784184931.585512:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239226240 00000100:00100000:3.0:1784184931.585597:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 248 00000100:00100000:3.0:1784184931.585610:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239226240:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184931.585628:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184931.585657:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186de6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.585687:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.585710:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184931.585720:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b400, rc 0) 00000100:00100000:3.0:1784184931.585790:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239226240:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 183us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184931.585798:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 248 00000100:00100000:3.0:1784184931.593665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184931.593753:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239226368 00000100:00100000:2.0:1784184931.593764:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239226368 00000100:00100000:2.0:1784184931.593825:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 249 00000100:00100000:2.0:1784184931.593835:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239226368:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184931.594139:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239226368:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 305us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184931.594148:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 249 00000100:00100000:3.0:1784184931.606483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184931.606664:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239226496 00000100:00100000:1.0:1784184931.606674:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239226496 00000100:00100000:1.0:1784184931.606730:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 250 00000100:00100000:1.0:1784184931.606741:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239226496:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184931.606972:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239226496:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 232us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184931.606980:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 250 00010000:00010000:3.0:1784184931.850583:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184932.874514:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184933.904921:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184934.091273:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184934.091301:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265478272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184934.091391:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184934.091468:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478272 00000100:00100000:0.0:1784184934.091482:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478272 00000100:00100000:0.0:1784184934.091539:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784184934.091549:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265478272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784184934.091583:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184934.091631:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265478272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184934.091638:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1784184934.091658:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784184934.091691:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13a8e00 x1870853265478272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184934.091711:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265478272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184934.092153:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265478528:0@lo:400:kworker.0 00000100:00100000:2.0:1784184934.092169:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265478400:0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.092187:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184934.092200:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184934.092222:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478528 00000100:00100000:0.0:1784184934.092226:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478528 00000100:00100000:2.0:1784184934.092234:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265478912:0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.092254:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784184934.092257:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184934.092261:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265478528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.092295:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265478528:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184934.092297:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478400 00000100:00100000:0.0:1784184934.092301:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784184934.092306:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478400 00000100:00100000:0.0:1784184934.092311:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478912 00000100:00100000:0.0:1784184934.092314:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478912 00000100:00100000:2.0:1784184934.092347:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1784184934.092349:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784184934.092354:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265478400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.092354:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265478912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.092596:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265478912:12345-0@lo:400:kworker.0 Request processed in 31us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184934.092611:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1784184934.092635:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184934.092645:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265478784:0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.092674:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184934.092700:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784184934.092706:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265478656:0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.092730:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184934.092766:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265478528:0@lo:400:kworker.0 00000100:00100000:1.0:1784184934.092827:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478784 00000100:00100000:1.0:1784184934.092832:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478784 00000100:00100000:1.0:1784184934.092867:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784184934.092874:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265478784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184934.092914:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265478784:12345-0@lo:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184934.092920:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784184934.101294:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265478656 00000100:00100000:1.0:1784184934.101309:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265478656 00000100:00100000:1.0:1784184934.101391:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784184934.101401:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265478656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184934.101502:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265478656:12345-0@lo:400:kworker.0 Request processed in 102us (8770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184934.101510:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1784184934.104668:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784184934.104679:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184934.104750:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265478656:0@lo:400:kworker.0 00010000:00080000:1.0:1784184934.104773:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb89c1f80 x1870853265478784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184934.104785:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265478784:0@lo:400:kworker.0 00000100:00100000:2.0:1784184934.105277:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265478400:12345-0@lo:400:kworker.0 Request processed in 12921us (13073us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184934.105290:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1784184934.109652:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265478400:0@lo:400:kworker.0 00000100:00100000:0.0:1784184934.109676:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265478912:0@lo:400:kworker.0 00000001:02000400:1.0:1784184934.793921:0:11224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784184934.923453:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184935.005830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184935.005859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184935.005878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184935.005904:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239226624 00000100:00100000:3.0:1784184935.005913:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239226624 00000100:00100000:3.0:1784184935.005958:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 252 00000100:00100000:3.0:1784184935.006719:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239226624:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184935.006804:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239226624:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 836us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184935.006812:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 252 00000100:00100000:3.0:1784184935.006854:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239226880 00000100:00100000:3.0:1784184935.006858:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239226880 00000100:00100000:3.0:1784184935.006890:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239226752 00000100:00100000:3.0:1784184935.006893:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239226752 00000100:00100000:3.0:1784184935.006910:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:3.0:1784184935.006916:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239226880:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184935.006941:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239226880:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184935.006947:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:3.0:1784184935.006956:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:3.0:1784184935.006961:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239226752:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184935.008424:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239226752:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 1453us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184935.008436:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00080000:3.0:1784184935.009117:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184935.626800:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265479040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184935.626874:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184935.627291:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479040 00000100:00100000:1.0:1784184935.627300:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479040 00000100:00100000:1.0:1784184935.627376:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784184935.627386:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265479040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784184935.627424:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184935.630546:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265479040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3151us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184935.630561:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1784184935.630837:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb7123b80 x1870853265479040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184935.630862:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265479040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184935.946520:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184936.973454:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184937.995196:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184939.019571:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784184939.093722:0:11324:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:55:37 (1784184937) === 00000100:00100000:1.0:1784184939.216683:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265479168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184939.216786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184939.216861:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265479680:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.216897:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184939.216971:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784184939.216978:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265479296:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184939.217036:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265479808:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217063:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184939.217102:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265479552:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217130:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184939.217150:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784184939.217156:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265479424:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217178:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184939.217196:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265479936:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217218:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184939.217251:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479680 00000100:00100000:1.0:1784184939.217260:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479680 00000100:00100000:1.0:1784184939.217324:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479936 00000100:00100000:1.0:1784184939.217327:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479936 00000100:00100000:1.0:1784184939.217386:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784184939.217396:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265479680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217458:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265479680:12345-0@lo:400:kworker.0 Request processed in 63us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.217466:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784184939.217496:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784184939.217505:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265479936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217540:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265479936:12345-0@lo:400:kworker.0 Request processed in 38us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.217547:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784184939.217588:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479296 00000100:00100000:1.0:1784184939.217592:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479296 00000100:00100000:1.0:1784184939.217624:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784184939.217630:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265479296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217659:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265479296:12345-0@lo:400:kworker.0 Request processed in 30us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.217664:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784184939.217692:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479808 00000100:00100000:1.0:1784184939.217696:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479808 00000100:00100000:1.0:1784184939.217727:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479552 00000100:00100000:1.0:1784184939.217730:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479552 00000100:00100000:1.0:1784184939.217743:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479424 00000100:00100000:1.0:1784184939.217745:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479424 00000100:00100000:1.0:1784184939.217759:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784184939.217767:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265479808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217803:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265479808:12345-0@lo:400:kworker.0 Request processed in 38us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.217809:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784184939.217821:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784184939.217828:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265479552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217855:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265479552:12345-0@lo:400:kworker.0 Request processed in 27us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.217861:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784184939.217876:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784184939.217883:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265479424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.217917:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265479424:12345-0@lo:400:kworker.0 Request processed in 35us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.217936:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1784184939.217989:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784184939.217998:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784184939.218001:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184939.218059:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265479424:0@lo:400:kworker.0 00010000:00080000:1.0:1784184939.218076:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbd2680 x1870853265479936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184939.218088:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265479936:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.218098:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265479552:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.218137:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265479296:0@lo:400:kworker.0 00000100:00100000:1.0:1784184939.218148:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265479808:0@lo:400:kworker.0 00010000:00080000:1.0:1784184939.218159:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbd2a00 x1870853265479680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184939.218169:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265479680:0@lo:400:kworker.0 00000100:00100000:2.0:1784184939.218433:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265479168 00000100:00100000:2.0:1784184939.218439:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265479168 00000100:00100000:2.0:1784184939.218479:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784184939.218487:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265479168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184939.218525:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184939.218591:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265479168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184939.218598:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1784184939.218681:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13ab480 x1870853265479168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184939.218700:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265479168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184939.276604:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.276808:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239227008 00000100:00100000:3.0:1784184939.276825:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239227008 00000100:00100000:3.0:1784184939.276925:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784184939.276938:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239227008:12345-192.168.201.29@tcp:41:mkdir.0 00000100:00100000:1.0:1784184939.277012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000004:00000024:3.0:1784184939.277014:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784184939.277521:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239227008:12345-192.168.201.29@tcp:41:mkdir.0 Request processed in 581us (923us total) trans 0 rc 0/0 00000100:00080000:0.0:1784184939.277523:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184939.277552:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784184939.277619:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239227136 00000100:00100000:3.0:1784184939.278288:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239227136 00000100:00100000:3.0:1784184939.278373:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1784184939.278383:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:9683:x1870853239227136:12345-192.168.201.29@tcp:700:mkdir.0 00000100:00100000:3.0:1784184939.278466:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:9683:x1870853239227136:12345-192.168.201.29@tcp:700:mkdir.0 Request processed in 84us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184939.278475:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1784184939.292801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.292939:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239227392 00000100:00100000:3.0:1784184939.292953:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239227392 00000100:00100000:3.0:1784184939.293065:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1784184939.293077:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:9683:x1870853239227392:12345-192.168.201.29@tcp:36:mkdir.0 00010000:00010000:3.0:1784184939.293166:0:7503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184939.293382:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8aff90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d68 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.293414:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784184939.293431:0:7503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184939.294204:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.294222:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.294232:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.294271:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.294285:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.294291:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184939.296231:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1784184939.296249:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.296258:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.296266:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.296272:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.296276:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.296284:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.296298:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f93b83400) 00010000:00010000:3.0:1784184939.296302:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.296306:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.296312:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784184939.296355:0:7503:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054899bd7 reply state 00000000729601c7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184939.296372:0:7503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784184939.297416:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9683:x1870853239227392:12345-192.168.201.29@tcp:36:mkdir.0 Request processed in 4333us (4622us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784184939.297427:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1784184939.313814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184939.314692:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239227520 00000100:00100000:0.0:1784184939.314713:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239227520 00000100:00100000:0.0:1784184939.314801:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1784184939.314814:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9684:x1870853239227520:12345-192.168.201.29@tcp:101:chmod.0 00010000:00010000:0.0:1784184939.314860:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184939.314895:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ded expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.315003:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b00c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.315020:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b00c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.315037:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b00c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184939.315118:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1784184939.315124:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184939.315183:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b00c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.315196:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.315215:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.315218:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ded expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.315247:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.315264:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b00c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ded expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.315273:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184939.315285:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.315287:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184939.315297:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784184939.315304:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c000, rc 0) 00010000:00010000:1.0:1784184939.315308:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.315359:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b5f93b83d00) 00010000:00010000:1.0:1784184939.315363:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184939.315368:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.315375:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b00b6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184939.317539:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9684:x1870853239227520:12345-192.168.201.29@tcp:101:chmod.0 Request processed in 2712us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184939.319029:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784184939.333114:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184939.333259:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239227776 00000100:00100000:0.0:1784184939.333285:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239227776 00000100:00100000:0.0:1784184939.333390:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1784184939.333586:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9684:x1870853239227776:12345-192.168.201.29@tcp:36:chmod.0 00010000:00010000:0.0:1784184939.333665:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184939.333702:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b00c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ded expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.333725:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184939.333738:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184939.333771:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.333787:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.333800:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784184939.334350:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b02ca78 reply state 00000000e134cf6b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184939.334365:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784184939.334383:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784184939.336056:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:9684:x1870853239227776:12345-192.168.201.29@tcp:36:chmod.0 Request processed in 2465us (2947us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784184939.342897:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00010000:00010000:3.0:1784184939.355145:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.355165:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.355175:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.355182:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.355186:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.355194:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.355213:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3500) 00010000:00010000:3.0:1784184939.355216:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784184939.355221:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.355227:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b00cb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184939.380982:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.381066:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239227904 00000100:00100000:3.0:1784184939.381093:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239227904 00000100:00100000:3.0:1784184939.381160:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1784184939.381170:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9685:x1870853239227904:12345-192.168.201.29@tcp:101:chown.0 00010000:00010000:3.0:1784184939.381197:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184939.381363:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186df4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.381467:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b00d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.381486:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b00d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.381502:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b00d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184939.381598:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784184939.381602:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784184939.381664:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b00d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.381697:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b00d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186df4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.381722:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b00d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186df4 expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.381732:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f93b83400) 00010000:00010000:3.0:1784184939.381736:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784184939.381740:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f200, rc 0) 00000100:00100000:3.0:1784184939.381827:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+8:9685:x1870853239227904:12345-192.168.201.29@tcp:101:chown.0 Request processed in 658us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184939.381836:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1784184939.384760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184939.384867:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239228032 00000100:00100000:1.0:1784184939.384882:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239228032 00000100:00100000:1.0:1784184939.384978:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1784184939.384990:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:9685:x1870853239228032:12345-192.168.201.29@tcp:101:chown.0 00010000:00010000:1.0:1784184939.385017:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184939.385044:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8c00/0x63160f6fbe8b00e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186dfb expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385145:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385166:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385194:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385362:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385371:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385380:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385538:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b00f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385547:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b00f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385554:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b00f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184939.385620:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1784184939.385624:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784184939.385661:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b00f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385675:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385682:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385702:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385709:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184939.385714:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385722:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385735:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f93b83400) 00010000:00010000:1.0:1784184939.385739:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184939.385744:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385752:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b00e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385767:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385774:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385780:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385785:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184939.385788:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385804:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385812:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b5f8c4f5e00) 00010000:00010000:1.0:1784184939.385815:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184939.385818:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385824:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b00ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385862:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8c00/0x63160f6fbe8b00e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186dfb expref: 10 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385878:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b00f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186dfb expref: 9 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.385887:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784184939.385890:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784184939.385892:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8800, rc 0) 00000100:00100000:1.0:1784184939.385986:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+9:9685:x1870853239228032:12345-192.168.201.29@tcp:101:chown.0 Request processed in 998us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.385997:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1784184939.396060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184939.396174:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239228288 00000100:00100000:0.0:1784184939.396190:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239228288 00000100:00100000:0.0:1784184939.396421:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1784184939.396446:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+9:9685:x1870853239228288:12345-192.168.201.29@tcp:36:chown.0 00010000:00010000:0.0:1784184939.396524:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184939.396559:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b00f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186dfb expref: 9 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.396580:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:0.0:1784184939.396592:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184939.396623:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.396697:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.396714:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784184939.469684:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1784184939.481964:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de936e7c reply state 00000000fc088819 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184939.481993:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784184939.482281:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1784184939.482474:0:5793:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784184939.482511:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9685:x1870853239228288:12345-192.168.201.29@tcp:36:chown.0 Request processed in 86061us (86463us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784184939.482522:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:3.0:1784184939.482932:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.482945:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.482964:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.482972:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.482978:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.482987:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.483008:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:3.0:1784184939.483012:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784184939.483018:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.483024:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b00fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184939.511220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184939.511328:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239228416 00000100:00100000:2.0:1784184939.511497:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239228416 00000100:00100000:1.0:1784184939.511686:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1784184939.511703:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:9686:x1870853239228416:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:1.0:1784184939.511739:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184939.511770:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e02 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784184939.513427:0:7503:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1575us 00010000:00010000:3.0:1784184939.547894:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.547938:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.547967:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.548081:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.548090:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.548098:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.549265:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.549283:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.549294:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184939.549471:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784184939.549477:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784184939.550466:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550493:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550513:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550520:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550528:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.550533:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550541:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550558:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f93b83400) 00010000:00010000:3.0:1784184939.550561:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.550566:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550586:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b010a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550603:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550610:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550616:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550621:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.550630:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550637:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550646:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b5f93b83b00) 00010000:00010000:3.0:1784184939.550649:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.550652:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550659:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550716:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e02 expref: 8 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550734:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e02 expref: 7 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.550742:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:3.0:1784184939.550744:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784184939.550747:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f800, rc 0) 00000100:00100000:3.0:1784184939.550854:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9686:x1870853239228416:12345-192.168.201.29@tcp:101:touch.500 Request processed in 39154us (39652us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184939.550866:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1784184939.558508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.558620:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239228672 00000100:00100000:3.0:1784184939.558634:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239228672 00000100:00100000:3.0:1784184939.558715:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1784184939.558729:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9686:x1870853239228672:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:3.0:1784184939.558779:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184939.558817:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b011f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e09 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.559655:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.559680:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.559696:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.563294:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.563320:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.563362:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784184939.564858:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784184939.565162:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565177:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565189:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565242:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565249:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565256:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565263:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.565267:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565274:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565288:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:3.0:1784184939.565291:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.565295:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565301:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0126 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784184939.565314:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039862250 reply state 0000000000b05955 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184939.565324:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784184939.565425:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b011f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e09 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565464:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e09 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.565472:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f93b83700) 00010000:00010000:3.0:1784184939.565475:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784184939.565477:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e600, rc 0) 00000100:00100000:3.0:1784184939.565555:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+10:9686:x1870853239228672:12345-192.168.201.29@tcp:101:touch.500 Request processed in 6829us (7060us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784184939.565564:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00010000:00010000:3.0:1784184939.574396:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.574419:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.574426:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.574433:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.574439:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.574448:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.574468:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9b5f93b83b00) 00010000:00010000:3.0:1784184939.574471:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.574477:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.574503:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b012d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184939.574618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.574709:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239228928 00000100:00100000:3.0:1784184939.574722:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239228928 00000100:00100000:3.0:1784184939.574845:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1784184939.574856:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:9686:x1870853239228928:12345-192.168.201.29@tcp:36:touch.500 00010000:00010000:3.0:1784184939.574932:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184939.574965:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e09 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.574979:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f93b83700) 00010000:00010000:3.0:1784184939.574986:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184939.575043:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.575074:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.575086:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784184939.575477:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030ece449 reply state 00000000e0e8db66 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184939.575490:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784184939.575613:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+10:9686:x1870853239228928:12345-192.168.201.29@tcp:36:touch.500 Request processed in 757us (999us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784184939.575623:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00010000:00010000:3.0:1784184939.580181:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.580204:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.580213:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.580221:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.580227:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.580236:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.580261:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f93b83000) 00010000:00010000:3.0:1784184939.580264:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.580271:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.580277:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0142 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184939.580452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184939.581026:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239229056 00000100:00100000:2.0:1784184939.581041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239229056 00000100:00100000:2.0:1784184939.581239:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1784184939.581252:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+9:9686:x1870853239229056:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:2.0:1784184939.581289:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184939.581322:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b0149 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184939.581578:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b0149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e10 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184939.581598:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b0149 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e10 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184939.581620:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:2.0:1784184939.581624:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784184939.581627:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971200, rc 0) 00000100:00100000:2.0:1784184939.581713:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+10:9686:x1870853239229056:12345-192.168.201.29@tcp:101:touch.500 Request processed in 462us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184939.581721:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1784184939.591933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184939.592013:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239229184 00000100:00100000:1.0:1784184939.592028:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239229184 00000100:00100000:1.0:1784184939.592093:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784184939.592103:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239229184:12345-192.168.201.29@tcp:8:touch.500 00010000:00080000:1.0:1784184939.592151:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:1.0:1784184939.592209:0:6589:0:(genops.c:1406:class_connect()) connect: client 89741aef-63f5-4e1f-9ce7-defb19b62903, cookie 0x63160f6fbe8b0150 00002000:00100000:1.0:1784184939.592225:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 89741aef-63f5-4e1f-9ce7-defb19b62903/ffff9b5f872aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784184939.592241:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784184939.593207:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784184939.593253:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5f872a9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784184939.595546:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2352:x1870853239229184:12345-192.168.201.29@tcp:8:touch.500 Request processed in 3423us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184939.595568:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784184939.602603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184939.602724:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239229312 00000100:00100000:2.0:1784184939.602739:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239229312 00000100:00100000:2.0:1784184939.602907:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1784184939.602921:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:0:x1870853239229312:12345-192.168.201.29@tcp:2:touch.500 00000100:00080000:0.0:1784184939.606380:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1784184939.661269:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000001:00080000:0.0:1784184939.661300:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1784184939.661545:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:0:x1870853239229312:12345-192.168.201.29@tcp:2:touch.500 Request processed in 58618us (58949us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784184939.661559:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1784184939.664643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184939.664775:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239229568 00000100:00100000:0.0:1784184939.664789:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239229568 00000100:00100000:0.0:1784184939.664866:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1784184939.664879:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+10:9686:x1870853239229568:12345-192.168.201.29@tcp:35:touch.500 00000100:00100000:0.0:1784184939.665566:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+11:9686:x1870853239229568:12345-192.168.201.29@tcp:35:touch.500 Request processed in 685us (933us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784184939.665578:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1784184939.707807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.707916:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239229696 00000100:00100000:3.0:1784184939.707929:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239229696 00000100:00100000:3.0:1784184939.708056:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:3.0:1784184939.708070:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+11:9687:x1870853239229696:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:3.0:1784184939.708123:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184939.708152:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e17 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.708244:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b015e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.708262:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b015e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.708277:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b015e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184939.708401:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784184939.708405:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784184939.708455:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b015e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.708488:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e17 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.708511:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b015e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e17 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.708520:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:3.0:1784184939.708523:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784184939.708528:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e600, rc 0) 00000100:00100000:3.0:1784184939.708662:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+12:9687:x1870853239229696:12345-192.168.201.29@tcp:101:rm.0 Request processed in 594us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184939.708670:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1784184939.715785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184939.715904:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239229952 00000100:00100000:2.0:1784184939.715918:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239229952 00000100:00100000:2.0:1784184939.716010:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1784184939.716023:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+12:9687:x1870853239229952:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:2.0:1784184939.716058:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184939.716089:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b0165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184939.716265:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784184939.716557:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b0165 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e1e expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184939.716576:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f93b83400) 00010000:00010000:2.0:1784184939.716579:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784184939.716585:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b0165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e1e expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184939.716602:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970a00, rc 0) 00000100:00100000:2.0:1784184939.716900:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:9687:x1870853239229952:12345-192.168.201.29@tcp:101:rm.0 Request processed in 879us (1131us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1784184939.716910:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:0.0:1784184939.735945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.736109:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239230080 00000100:00100000:3.0:1784184939.736123:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239230080 00000100:00100000:3.0:1784184939.736200:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1784184939.736221:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+13:9687:x1870853239230080:12345-192.168.201.29@tcp:37:rm.0 00000100:00100000:0.0:1784184939.741300:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+13:9687:x1870853239230080:12345-192.168.201.29@tcp:37:rm.0 Request processed in 5072us (5352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184939.741366:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1784184939.754465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184939.754588:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239230336 00000100:00100000:0.0:1784184939.754602:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239230336 00000100:00100000:0.0:1784184939.754679:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1784184939.754691:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa0561050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:9687:x1870853239230336:12345-192.168.201.29@tcp:35:rm.0 00000100:00100000:0.0:1784184939.755081:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa0561050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:9687:x1870853239230336:12345-192.168.201.29@tcp:35:rm.0 Request processed in 390us (632us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784184939.755091:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1784184939.760144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.760264:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239230592 00000100:00100000:3.0:1784184939.760277:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239230592 00000100:00100000:3.0:1784184939.760398:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:3.0:1784184939.760410:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:9687:x1870853239230592:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:3.0:1784184939.760445:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184939.760475:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e25 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.760869:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b017a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.760890:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b017a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.760905:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b017a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184939.760917:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784184939.761105:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b0173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e25 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.761128:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b017a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e25 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.761138:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:3.0:1784184939.761162:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784184939.761167:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f600, rc 0) 00000100:00100000:3.0:1784184939.761312:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:9687:x1870853239230592:12345-192.168.201.29@tcp:101:rm.0 Request processed in 904us (1186us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784184939.761321:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:1.0:1784184939.767584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.767687:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239230720 00000100:00100000:3.0:1784184939.767701:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239230720 00000100:00100000:3.0:1784184939.767783:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1784184939.767795:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+16:9687:x1870853239230720:12345-192.168.201.29@tcp:41:rm.0 00000004:00000024:3.0:1784184939.767882:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1784184939.767995:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+16:9687:x1870853239230720:12345-192.168.201.29@tcp:41:rm.0 Request processed in 195us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184939.768003:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1784184939.773154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184939.775106:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239230848 00000100:00100000:0.0:1784184939.775129:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239230848 00000100:00100000:0.0:1784184939.775283:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1784184939.775297:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:9687:x1870853239230848:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:0.0:1784184939.775326:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184939.775388:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b0188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e2c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775476:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775495:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775511:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775529:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775562:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775582:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775754:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b019d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775764:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b019d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775771:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b019d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184939.775806:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784184939.775811:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184939.775833:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b019d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775846:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b019d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775855:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775862:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775870:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775888:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184939.775893:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775901:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775917:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:0.0:1784184939.775921:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184939.775927:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775933:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b018f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775961:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775968:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775974:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.775979:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631de00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184939.775982:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.776003:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.776021:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9b5f87fe3600) 00010000:00010000:0.0:1784184939.776023:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184939.776026:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.776033:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b0196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.776068:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c000/0x63160f6fbe8b0188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e2c expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.776084:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b019d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e2c expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184939.776102:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:0.0:1784184939.776104:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184939.776108:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631dc00, rc 0) 00000100:00100000:0.0:1784184939.776211:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+17:9687:x1870853239230848:12345-192.168.201.29@tcp:101:rm.0 Request processed in 916us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184939.776220:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1784184939.781928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184939.782138:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239231104 00000100:00100000:3.0:1784184939.782153:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239231104 00000100:00100000:3.0:1784184939.782239:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:3.0:1784184939.782251:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+17:9687:x1870853239231104:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:3.0:1784184939.782363:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784184939.782401:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b019d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e2c expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782426:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b0149 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e10 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782439:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:3.0:1784184939.782460:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b015e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e17 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782491:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:3.0:1784184939.782495:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184939.782524:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782540:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782551:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782701:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782711:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782719:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782933:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782943:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.782963:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784184939.784883:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1784184939.784903:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337950570096ns, next at 338950566016ns, rc = 0 00010000:00010000:3.0:1784184939.785018:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785037:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785049:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785058:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785065:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785072:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785232:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784184939.785264:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785272:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785278:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785286:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.785291:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785301:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785325:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f93b83700) 00010000:00010000:3.0:1784184939.785328:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784184939.785464:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785471:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b01b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785493:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785499:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785505:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785510:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.785513:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785519:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785527:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:3.0:1784184939.785530:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.785532:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.785538:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f000/0x63160f6fbe8b01a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784184939.785559:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b2ef42d reply state 00000000030673e8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184939.785582:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784184939.785814:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+16:9687:x1870853239231104:12345-192.168.201.29@tcp:36:rm.0 Request processed in 3558us (3894us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784184939.785826:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00010000:00010000:1.0:1784184939.789255:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784184939.789276:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.789318:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ee00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784184939.789324:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.789543:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.789578:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b5f93b83700) 00010000:00010000:1.0:1784184939.789582:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784184939.789588:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.789594:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b01b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.789627:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184939.789629:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184939.789631:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184939.794798:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.794824:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.794834:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.794842:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.794848:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.794857:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.794881:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9b5f93b83000) 00010000:00010000:3.0:1784184939.794885:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.794891:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.794898:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b01ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184939.796295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184939.796546:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239231360 00000100:00100000:1.0:1784184939.796560:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239231360 00000100:00100000:1.0:1784184939.796651:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1784184939.796662:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+15:9687:x1870853239231360:12345-192.168.201.29@tcp:35:rm.0 00000100:00100000:1.0:1784184939.797070:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+16:9687:x1870853239231360:12345-192.168.201.29@tcp:35:rm.0 Request processed in 408us (786us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784184939.797080:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1784184939.803499:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184939.803681:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239231616 00000100:00100000:1.0:1784184939.803695:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239231616 00000100:00100000:1.0:1784184939.803781:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1784184939.803793:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+16:9687:x1870853239231616:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:1.0:1784184939.803896:0:7503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784184939.803934:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b017a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e25 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.803970:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e02 expref: 15 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.803984:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f93b83e00) 00010000:00010000:1.0:1784184939.804185:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b00d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186df4 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.804195:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f93b83400) 00010000:00010000:1.0:1784184939.804202:0:7503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784184939.804235:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.804251:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.804263:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.804279:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.804286:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.804293:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.807927:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.807985:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.808001:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184939.808983:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784184939.809008:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809018:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809025:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809031:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184939.809036:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809045:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809061:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b5f8c4f5300) 00010000:00010000:1.0:1784184939.809063:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784184939.809069:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809088:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b01ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809120:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809128:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809134:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809140:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184939.809143:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809149:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809157:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:1.0:1784184939.809160:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184939.809163:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184939.809168:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b01c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784184939.809180:0:7503:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000807d1d4c reply state 0000000044b87720 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184939.809191:0:7503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784184939.809371:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+15:9687:x1870853239231616:12345-192.168.201.29@tcp:36:rm.0 Request processed in 5574us (5882us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784184939.809381:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00010000:00010000:3.0:1784184939.816268:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.816292:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.816301:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.816308:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184939.816315:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.816324:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.816379:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b5f8c4f5e00) 00010000:00010000:3.0:1784184939.816383:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184939.816389:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184939.816396:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b01c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184940.042647:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184940.111587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184940.111713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184940.111756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184940.112889:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239231872 00000100:00100000:1.0:1784184940.112908:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239231872 00000100:00100000:1.0:1784184940.113016:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:1.0:1784184940.113029:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239231872:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184940.113140:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239231872:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 113us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184940.113148:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1784184940.116222:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232000 00000100:00100000:0.0:1784184940.116243:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232000 00000100:00100000:0.0:1784184940.116406:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:0.0:1784184940.116420:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239232000:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184940.116528:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239232000:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 112us (4815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184940.116537:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00080000:1.0:1784184940.116661:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184940.137587:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239231744 00000100:00100000:3.0:1784184940.137607:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239231744 00000100:00100000:3.0:1784184940.138396:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 254 00000100:00100000:3.0:1784184940.138412:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239231744:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184940.138547:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239231744:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 138us (26975us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184940.138578:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 254 00000100:00100000:0.0:1784184940.746887:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184940.746920:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265480064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184940.747034:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184940.749707:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480064 00000100:00100000:0.0:1784184940.749730:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480064 00000100:00100000:0.0:1784184940.749850:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784184940.749862:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265480064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184940.749926:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184940.750056:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265480064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184940.750066:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1784184940.758405:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13ab480 x1870853265480064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184940.758444:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265480064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784184941.068382:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184942.090830:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184943.115627:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184944.151484:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184944.339139:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265480320:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339217:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184944.339268:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265480832:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339309:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184944.339370:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784184944.339377:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265480192:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339426:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184944.339452:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265480704:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339472:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184944.339498:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265480448:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339521:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184944.339540:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784184944.339546:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265480576:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339567:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184944.339607:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480320 00000100:00100000:2.0:1784184944.339614:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480320 00000100:00100000:2.0:1784184944.339657:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480704 00000100:00100000:2.0:1784184944.339660:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480704 00000100:00100000:2.0:1784184944.339682:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480448 00000100:00100000:2.0:1784184944.339685:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480448 00000100:00100000:2.0:1784184944.339705:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784184944.339728:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265480320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339786:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265480320:12345-0@lo:400:kworker.0 Request processed in 72us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184944.339794:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784184944.339815:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784184944.339824:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265480704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339864:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265480704:12345-0@lo:400:kworker.0 Request processed in 42us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184944.339871:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784184944.339898:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784184944.339904:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265480448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.339933:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265480448:12345-0@lo:400:kworker.0 Request processed in 30us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184944.339938:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784184944.339956:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480832 00000100:00100000:2.0:1784184944.339960:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480832 00000100:00100000:2.0:1784184944.339983:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480576 00000100:00100000:2.0:1784184944.339987:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480576 00000100:00100000:2.0:1784184944.340004:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784184944.340010:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265480832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.340039:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265480832:12345-0@lo:400:kworker.0 Request processed in 29us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184944.340045:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784184944.340056:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784184944.340061:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265480576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.340113:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265480576:12345-0@lo:400:kworker.0 Request processed in 51us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184944.340120:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784184944.340144:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480192 00000100:00100000:2.0:1784184944.340148:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480192 00000004:00080000:3.0:1784184944.340155:0:7812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342505822041ns, next at 343505819580ns, rc = 0 00000100:00100000:2.0:1784184944.340179:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1784184944.340187:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265480192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.340229:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265480192:12345-0@lo:400:kworker.0 Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184944.340236:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:2.0:1784184944.340276:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784184944.340280:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784184944.340283:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184944.340300:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784184944.340311:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265480960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184944.340364:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784184944.340424:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb9340700 x1870853265480576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184944.340437:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265480576:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.340449:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265480448:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.340478:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265480192:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.340488:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265480704:0@lo:400:kworker.0 00000100:00100000:2.0:1784184944.340497:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265480320:0@lo:400:kworker.0 00010000:00080000:2.0:1784184944.340505:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fb9342a00 x1870853265480832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184944.340512:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265480832:0@lo:400:kworker.0 00000100:00100000:3.0:1784184944.340822:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265480960 00000100:00100000:3.0:1784184944.340827:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265480960 00000100:00100000:3.0:1784184944.340867:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784184944.340888:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265480960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184944.340915:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184944.340954:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265480960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184944.340961:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1784184944.341058:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f83fd7b80 x1870853265480960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184944.341071:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265480960:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784184944.432543:0:11475:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1784184944.914407:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:3.0:1784184944.914427:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1784184944.914443:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1784184944.914462:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1784184944.914733:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184944.914754:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265481088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784184944.914827:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184944.914943:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265481088 00000100:00100000:1.0:1784184944.914951:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265481088 00000100:00100000:1.0:1784184944.915004:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784184944.915013:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265481088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784184944.915040:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1784184944.915075:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a58806b, atime: 0x6a58806b, ctime: 0x6a58806b, blocks: 0x1 00010000:00010000:1.0:1784184944.915083:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915100:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1784184944.915104:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784184944.915111:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915145:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915155:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915163:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915181:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784184944.915740:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265481088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 727us (911us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784184944.915749:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1784184944.915774:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784184944.915780:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915788:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8c00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784184944.915792:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915801:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915819:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915832:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042e58c54/0x63160f6fbe8b01d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184944.915850:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184944.915851:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184944.915853:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784184944.916023:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fbb0fea00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1784184944.916030:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265481088:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784184945.171954:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184945.243520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184945.243571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184945.243596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184945.243631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184945.243662:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232128 00000100:00100000:2.0:1784184945.243671:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232128 00000100:00100000:2.0:1784184945.243736:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 256 00000100:00100000:2.0:1784184945.243748:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239232128:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184945.243827:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239232128:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184945.243835:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 256 00000100:00100000:2.0:1784184945.243879:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232384 00000100:00100000:2.0:1784184945.243882:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232384 00000100:00100000:2.0:1784184945.243918:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:2.0:1784184945.243925:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239232384:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184945.243952:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239232384:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184945.243959:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00080000:2.0:1784184945.243977:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184945.244117:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232256 00000100:00100000:0.0:1784184945.244121:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232256 00000100:00100000:0.0:1784184945.244166:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232512 00000100:00100000:0.0:1784184945.244169:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232512 00000100:00100000:0.0:1784184945.244192:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:0.0:1784184945.244199:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239232256:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184945.244237:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239232256:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 37us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184945.244244:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:0.0:1784184945.244258:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:0.0:1784184945.244273:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239232512:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184945.244301:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239232512:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184945.244307:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00080000:2.0:1784184945.244570:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1784184945.746187:0:11525:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd6beaa30 20000000:00000080:2.0:1784184945.746206:0:11525:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b5f81219000 uarg=0000000000000000 20000000:01000000:2.0:1784184945.746242:0:11525:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784184945.746249:0:11525:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784184945.746253:0:11525:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1784184945.749723:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1784184945.750088:0:11525:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1784184945.758292:0:11525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1784184945.759030:0:11525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1784184945.759111:0:11525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1784184945.759132:0:11525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784184945.759151:0:11525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759170:0:11525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759177:0:11525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759183:0:11525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759192:0:11525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759198:0:11525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759205:0:11525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759262:0:11525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759278:0:11525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 12 pid: 5786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.759294:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481216:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184945.759423:0:11525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.759431:0:11525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.759439:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481344:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184945.760052:0:11525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.760064:0:11525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 18 pid: 5786 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.760075:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481472:0@lo:104: 00000100:00100000:0.0:1784184945.760117:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784184945.760175:0:11525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.760184:0:11525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 18 pid: 5787 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.760203:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481600:0@lo:104: 00000100:00100000:0.0:1784184945.760226:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784184945.760250:0:11525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.760257:0:11525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 18 pid: 5784 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.760264:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481728:0@lo:104: 00000100:00100000:0.0:1784184945.760286:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184945.760295:0:11525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184945.761890:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784184945.761915:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265481472 00000100:00100000:1.0:1784184945.761922:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265481472 00000100:00100000:1.0:1784184945.761963:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265481600 00000100:00100000:1.0:1784184945.761966:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265481600 00000100:00100000:1.0:1784184945.761977:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265481728 00000100:00100000:1.0:1784184945.761979:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265481728 00000100:00100000:1.0:1784184945.761992:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784184945.761999:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:11525:x1870853265481472:12345-0@lo:104: 00010000:00010000:1.0:1784184945.762015:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762096:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784184945.762102:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+5:11525:x1870853265481472:12345-0@lo:104: Request processed in 103us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.762110:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784184945.762127:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184945.762133:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:11525:x1870853265481600:12345-0@lo:104: 00010000:00010000:1.0:1784184945.762141:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762196:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784184945.762201:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+4:11525:x1870853265481600:12345-0@lo:104: Request processed in 69us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.762207:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784184945.762221:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784184945.762227:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:11525:x1870853265481728:12345-0@lo:104: 00010000:00010000:1.0:1784184945.762233:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762263:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784184945.762268:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfa61050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+3:11525:x1870853265481728:12345-0@lo:104: Request processed in 42us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.762273:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1784184945.762310:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784184945.762317:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762324:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9800 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:1.0:1784184945.762364:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762375:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184945.762382:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184945.762388:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784184945.762427:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762433:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184945.762451:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762458:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9800/0x63160f6fbe8b0093 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b009a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762471:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784184945.762474:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762480:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:1.0:1784184945.762483:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762490:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184945.762497:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184945.762502:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784184945.762515:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762522:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184945.762528:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762545:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d000/0x63160f6fbe8b0085 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b008c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762554:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784184945.762557:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762563:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:1.0:1784184945.762566:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762573:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784184945.762578:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184945.762583:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784184945.762598:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762603:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784184945.762619:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762625:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b0077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b007e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.762640:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184945.762647:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184945.762649:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184945.762663:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265481856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784184945.762697:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184945.762886:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184945.762893:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265481984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784184945.762919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184945.762944:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265482112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784184945.762968:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184945.762995:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265481856 00000100:00100000:1.0:1784184945.762999:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265481856 00010000:00010000:1.0:1784184945.763016:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 19 pid: 5786 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184945.763033:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265481984 00000100:00100000:1.0:1784184945.763036:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265481984 00010000:00010000:1.0:1784184945.763046:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 20 pid: 5787 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184945.763055:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265482112 00000100:00100000:1.0:1784184945.763057:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265482112 00010000:00010000:1.0:1784184945.763066:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 21 pid: 5784 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184945.763077:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784184945.763084:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+21:3313:x1870853265481856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784184945.763094:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184945.763099:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 21 pid: 5786 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.763121:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 21 pid: 5786 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.763141:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184945.763172:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+21:3313:x1870853265481856:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.763179:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784184945.763193:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784184945.763199:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+20:3313:x1870853265481984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784184945.763207:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184945.763211:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 20 pid: 5787 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.763218:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 20 pid: 5787 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.763226:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184945.763246:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+20:3313:x1870853265481984:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.763252:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784184945.763263:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784184945.763269:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265482112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784184945.763275:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184945.763279:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 19 pid: 5784 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.763286:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 19 pid: 5784 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.763302:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184945.763326:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265482112:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.763353:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784184945.763403:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265482112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784184945.763428:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265481984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784184945.763434:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265481856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784184945.764872:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184945.765043:0:11525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b009a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b0093 expref: 18 pid: 5786 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.765060:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481472:0@lo:104: 00010000:00010000:0.0:1784184945.765072:0:11525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5fbfbd8200/0x63160f6fbe8b008c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b0085 expref: 17 pid: 5787 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.765079:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481600:0@lo:104: 00010000:00010000:0.0:1784184945.765089:0:11525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b007e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b0077 expref: 16 pid: 5784 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184945.765097:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481728:0@lo:104: 00010000:00010000:3.0:1784184945.765865:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184945.769770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184945.769798:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481216:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184945.769820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184945.769826:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11525:1870853265481344:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184945.769886:0:11525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184945.770035:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232640 00000100:00100000:1.0:1784184945.770044:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232640 00010000:00010000:1.0:1784184945.770083:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 13 pid: 5786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184945.770129:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232768 00000100:00100000:1.0:1784184945.770133:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232768 00010000:00010000:1.0:1784184945.770145:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 14 pid: 5787 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184945.770174:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1784184945.770183:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe70326-3f31-45ab-b972-c3f25a334a81+14:2355:x1870853239232640:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184945.770203:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184945.770209:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 14 pid: 5786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770221:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 14 pid: 5786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770251:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164b400/0x63160f6fbe8b00a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186de6 expref: 14 pid: 5786 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770266:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184945.770359:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239232640:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 146us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.770368:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1784184945.770386:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:1.0:1784184945.770392:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe70326-3f31-45ab-b972-c3f25a334a81+12:2355:x1870853239232768:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184945.770400:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184945.770404:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770413:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770424:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b00a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ddf expref: 12 pid: 5787 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770436:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770444:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770458:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770476:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770483:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770489:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770495:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784184945.770499:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770508:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770519:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184945.770528:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184945.770550:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fe70326-3f31-45ab-b972-c3f25a334a81+11:2355:x1870853239232768:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 157us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184945.770557:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00010000:00010000:0.0:1784184945.770891:0:11525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.770900:0:11525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184945.770906:0:11525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b01dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184945.866744:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265482240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784184945.866875:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184945.867228:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265482240 00000100:00100000:0.0:1784184945.867244:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265482240 00000100:00100000:0.0:1784184945.867322:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784184945.867360:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265482240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184945.867415:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184945.867486:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265482240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184945.867494:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1784184945.867733:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f84464e00 x1870853265482240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184945.867778:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265482240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784184946.186567:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184946.962797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184946.962941:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239232896 00000100:00100000:1.0:1784184946.962954:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239232896 00000100:00100000:1.0:1784184946.963031:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 257 00000100:00100000:1.0:1784184946.963044:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:5573:x1870853239232896:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784184946.963078:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184946.963120:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b01e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186e33 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184946.963158:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b01e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e33 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184946.963173:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b01e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e33 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184946.963184:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9000, rc 0) 00000100:00100000:1.0:1784184946.963275:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239232896:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 232us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184946.963283:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 257 00000100:00100000:1.0:1784184946.977585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184946.977693:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233024 00000100:00100000:2.0:1784184946.977702:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233024 00000100:00100000:2.0:1784184946.977757:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 258 00000100:00100000:2.0:1784184946.977780:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239233024:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784184946.978072:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239233024:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 305us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184946.978081:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 258 00000100:00100000:3.0:1784184946.981275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184946.981636:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233152 00000100:00100000:2.0:1784184946.981644:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233152 00000100:00100000:2.0:1784184946.981702:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 259 00000100:00100000:2.0:1784184946.981711:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239233152:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784184946.981940:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239233152:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 229us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184946.981947:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 259 00000100:00100000:0.0:1784184946.998001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184946.998260:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233280 00000100:00100000:1.0:1784184946.998270:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233280 00000100:00100000:1.0:1784184946.998376:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 260 00000100:00100000:1.0:1784184946.998387:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:9957:x1870853239233280:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784184946.998655:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:9957:x1870853239233280:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 269us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184946.998664:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 260 00000100:00100000:1.0:1784184947.008895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184947.010926:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233408 00000100:00100000:0.0:1784184947.010945:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233408 00000100:00100000:0.0:1784184947.011269:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 261 00000100:00100000:0.0:1784184947.011527:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+12:9957:x1870853239233408:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784184947.011804:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+12:9957:x1870853239233408:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 282us (2916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.011812:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 261 00000100:00100000:3.0:1784184947.016681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184947.016914:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233536 00000100:00100000:2.0:1784184947.016924:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233536 00000100:00100000:2.0:1784184947.016984:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 262 00000100:00100000:2.0:1784184947.017003:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+12:5573:x1870853239233536:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184947.017022:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184947.017039:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8b01ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838186e3a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184947.017067:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8b01ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e3a expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184947.017077:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8b01ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e3a expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184947.017103:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971200, rc 0) 00000100:00100000:2.0:1784184947.017159:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239233536:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 158us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184947.017166:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 262 00000100:00100000:2.0:1784184947.019609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184947.019712:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233664 00000100:00100000:1.0:1784184947.019721:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233664 00000100:00100000:1.0:1784184947.019814:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 263 00000100:00100000:1.0:1784184947.019824:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239233664:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.020147:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239233664:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 324us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.020162:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 263 00000100:00100000:1.0:1784184947.027736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184947.027875:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233792 00000100:00100000:0.0:1784184947.027902:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233792 00000100:00100000:0.0:1784184947.027962:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 264 00000100:00100000:0.0:1784184947.027972:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239233792:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.029458:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:5573:x1870853239233792:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 1479us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.029472:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 264 00000100:00100000:3.0:1784184947.038427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184947.038866:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239233920 00000100:00100000:1.0:1784184947.038876:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239233920 00000100:00100000:1.0:1784184947.038935:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 265 00000100:00100000:1.0:1784184947.038946:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:9959:x1870853239233920:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784184947.039267:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:9959:x1870853239233920:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 322us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.039276:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 265 00000100:00100000:3.0:1784184947.046879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184947.048065:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234048 00000100:00100000:0.0:1784184947.048077:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234048 00000100:00100000:0.0:1784184947.048142:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 266 00000100:00100000:0.0:1784184947.048152:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:9959:x1870853239234048:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784184947.048449:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:9959:x1870853239234048:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 296us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.048457:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 266 00010000:00010000:2.0:1784184947.210534:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784184947.594504:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784184947.594517:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbfbf1800 from 7 10000000:01000000:3.0:1784184947.594523:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784184947.594606:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184947.594620:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184947.594632:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184947.594663:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265482368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784184947.594760:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184947.594857:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e8266fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784184947.595058:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265482368 00000100:00100000:2.0:1784184947.595068:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265482368 00000100:00100000:2.0:1784184947.595127:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784184947.595136:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:5789:x1870853265482368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784184947.595149:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184947.595164:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971800/0x63160f6fbe8b01f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b01f1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184947.595201:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971800/0x63160f6fbe8b01f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b01f1 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184947.595213:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971800/0x63160f6fbe8b01f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b01f1 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184947.595224:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971800, rc 0) 00000100:00100000:2.0:1784184947.595280:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265482368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184947.595285:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784184947.595461:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265482368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784184947.595480:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184947.595489:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184947.595560:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265482496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184947.595608:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184947.595636:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e8266fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784184947.595688:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265482496 00000100:00100000:1.0:1784184947.595701:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265482496 00000100:00100000:1.0:1784184947.595772:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784184947.595781:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265482496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.596500:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265482496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 717us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.596510:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784184947.596673:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265482496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784184947.596723:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265482624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184947.596767:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184947.596869:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e8266fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184947.600629:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265482624 00000100:00100000:0.0:1784184947.600647:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265482624 00000100:00100000:0.0:1784184947.600727:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784184947.600740:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265482624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784184947.601253:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265482624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.601839:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265482624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 340us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.601849:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784184947.603214:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11539:1870853265482752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184947.603303:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184947.603361:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184947.603492:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265482752 00000100:00100000:1.0:1784184947.603498:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265482752 00000100:00100000:1.0:1784184947.603536:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1784184947.603545:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:11539:x1870853265482752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184947.603746:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:11539:x1870853265482752:12345-0@lo:502:llog_process_th.0 Request processed in 202us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.603753:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784184947.603852:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11539:1870853265482752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784184947.603883:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784184947.603897:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184947.603899:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784184947.603907:0:11539:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b5fbfbf1800 00000020:00000080:2.0:1784184947.603910:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784184947.603997:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11539:1870853265482880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184947.604031:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184947.604056:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fcc840 going to sleep for 11 seconds 00000100:00100000:1.0:1784184947.604280:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265482880 00000100:00100000:1.0:1784184947.604285:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265482880 00000100:00100000:1.0:1784184947.604323:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784184947.604349:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:11539:x1870853265482880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184947.604478:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:11539:x1870853265482880:12345-0@lo:502:llog_process_th.0 Request processed in 149us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.604489:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784184947.604844:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11539:1870853265482880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784184947.604867:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184947.604871:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184947.604873:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784184947.604878:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784184947.609816:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1784184947.609860:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784184947.609872:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184947.609885:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784184947.609896:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784184947.609899:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fc0d20000 from 7 10000000:01000000:1.0:1784184947.609901:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784184947.609939:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184947.609946:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184947.609956:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184947.609992:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.610062:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184947.610106:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784184947.610240:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483008 00000100:00100000:0.0:1784184947.610257:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483008 00000100:00100000:0.0:1784184947.610306:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784184947.610326:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:5789:x1870853265483008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784184947.610364:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184947.610377:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b0206 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b01ff expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.610398:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b0206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b01ff expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.610408:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b0206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b01ff expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.610416:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c600, rc 0) 00000100:00100000:0.0:1784184947.610457:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f9822a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265483008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.610464:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784184947.610665:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784184947.610689:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184947.610697:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184947.610746:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.610771:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184947.610801:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184947.610814:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483136 00000100:00100000:1.0:1784184947.610827:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483136 00000100:00100000:1.0:1784184947.610857:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1784184947.610863:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265483136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.611109:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265483136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.611117:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1784184947.611147:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.611173:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.611207:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184947.611218:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184947.611227:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483264 00000100:00100000:1.0:1784184947.611230:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483264 00000100:00100000:2.0:1784184947.611346:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784184947.611356:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265483264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784184947.611496:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265483264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184947.611502:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1784184947.611647:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784184947.618234:0:11541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11541:1870853265483392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184947.618385:0:11541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184947.618436:0:11541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c85240 going to sleep for 11 seconds 00000100:00100000:2.0:1784184947.618541:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483392 00000100:00100000:2.0:1784184947.618549:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483392 00000100:00100000:2.0:1784184947.618597:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1784184947.618606:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:11541:x1870853265483392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784184947.618853:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:11541:x1870853265483392:12345-0@lo:502:llog_process_th.0 Request processed in 247us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184947.618860:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1784184947.618957:0:11541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11541:1870853265483392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784184947.618997:0:11541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784184947.619007:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184947.619009:0:11541:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784184947.619018:0:11541:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b5fc0d20000 00000020:00000080:0.0:1784184947.619020:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784184947.619104:0:11541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11541:1870853265483520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184947.619140:0:11541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184947.619162:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483520 00000100:00100000:0.0:1784184947.619166:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483520 00000100:00100000:0.0:1784184947.619188:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784184947.619194:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:11541:x1870853265483520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184947.619354:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f98228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:11541:x1870853265483520:12345-0@lo:502:llog_process_th.0 Request processed in 137us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.619370:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784184947.619401:0:11541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184947.619413:0:11541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11541:1870853265483520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784184947.619436:0:11541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784184947.619440:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184947.619442:0:11541:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784184947.619445:0:11541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784184947.619497:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784184947.619517:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784184947.619525:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.619536:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784184947.619547:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784184947.619550:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5f85958000 from 7 10000000:01000000:0.0:1784184947.619552:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784184947.619576:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.619583:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.619592:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184947.619607:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.619633:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184947.619654:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184947.619667:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483648 00000100:00100000:0.0:1784184947.619671:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483648 00000100:00100000:0.0:1784184947.619688:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784184947.619694:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:5789:x1870853265483648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784184947.619702:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184947.619714:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c000/0x63160f6fbe8b0214 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b020d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.619734:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c000/0x63160f6fbe8b0214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b020d expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.619746:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631c000/0x63160f6fbe8b0214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b020d expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.619755:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c000, rc 0) 00000100:00100000:0.0:1784184947.619784:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265483648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.619790:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784184947.619817:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784184947.619844:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184947.619852:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184947.619892:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.619917:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184947.619938:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184947.619952:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483776 00000100:00100000:0.0:1784184947.619955:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483776 00000100:00100000:0.0:1784184947.619970:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784184947.619975:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265483776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.620186:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265483776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.620192:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784184947.620214:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.620234:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.620264:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184947.620275:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184947.620284:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265483904 00000100:00100000:0.0:1784184947.620287:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265483904 00000100:00100000:0.0:1784184947.620300:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784184947.620305:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265483904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.620425:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:5789:x1870853265483904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184947.620431:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784184947.620459:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:5789:1870853265483904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784184947.638693:0:11542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11542:1870853265484032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184947.638781:0:11542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184947.638845:0:11542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8821f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184947.638995:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484032 00000100:00100000:1.0:1784184947.639004:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484032 00000100:00100000:1.0:1784184947.639068:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1784184947.639078:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:11542:x1870853265484032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184947.639299:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:11542:x1870853265484032:12345-0@lo:502:llog_process_th.0 Request processed in 222us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.639306:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784184947.639504:0:11542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11542:1870853265484032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784184947.639534:0:11542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784184947.639547:0:11542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784184947.639549:0:11542:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784184947.639556:0:11542:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b5f85958000 00000020:00000080:0.0:1784184947.639559:0:11542:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784184947.639643:0:11542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11542:1870853265484160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784184947.639675:0:11542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184947.639692:0:11542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8821f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184947.641222:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484160 00000100:00100000:1.0:1784184947.641233:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484160 00000100:00100000:1.0:1784184947.641304:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784184947.641313:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:11542:x1870853265484160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784184947.641570:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:11542:x1870853265484160:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184947.641579:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1784184947.641722:0:11542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:11542:1870853265484160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784184947.641758:0:11542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784184947.641772:0:11542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784184947.641774:0:11542:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784184947.641780:0:11542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784184947.642006:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1784184947.642025:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784184947.642034:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184947.642045:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784184947.656777:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784184948.235365:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784184948.684942:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784184949.258989:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184949.451144:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265484672:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451220:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184949.451285:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784184949.451292:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265484544:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184949.451374:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484544 00000100:00100000:2.0:1784184949.451383:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484544 00000100:00100000:0.0:1784184949.451418:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265484416:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451444:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784184949.451456:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265484544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184949.451483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184949.451518:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265484544:12345-0@lo:400:kworker.0 Request processed in 65us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184949.451527:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784184949.451533:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265484928:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451543:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484416 00000100:00100000:2.0:1784184949.451547:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484416 00000100:00100000:2.0:1784184949.451569:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784184949.451576:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265484416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184949.451587:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184949.451615:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265484416:12345-0@lo:400:kworker.0 Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184949.451621:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784184949.451634:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265484416:0@lo:400:kworker.0 00000100:00080000:2.0:1784184949.451638:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184949.451655:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784184949.451664:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265484288:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451670:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265484544:0@lo:400:kworker.0 00000100:00100000:0.0:1784184949.451707:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184949.451721:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484672 00000100:00100000:2.0:1784184949.451726:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484672 00000100:00100000:0.0:1784184949.451741:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265484800:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451759:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484928 00000100:00100000:2.0:1784184949.451763:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484928 00000100:00100000:0.0:1784184949.451768:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184949.451812:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784184949.451819:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184949.451831:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784184949.451842:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265484928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451863:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265484672:12345-0@lo:400:kworker.0 Request processed in 44us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184949.451869:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1784184949.451883:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784184949.451886:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784184949.451892:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484800 00000100:00100000:2.0:1784184949.451895:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484800 00000100:00100000:2.0:1784184949.451918:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784184949.451924:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265484800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.451961:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265484800:12345-0@lo:400:kworker.0 Request processed in 37us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184949.451966:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1784184949.451981:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784184949.451999:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbf4f7800 x1870853265484672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184949.452009:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265484672:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.452029:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265484800:0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.452058:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265484288 00000100:00100000:2.0:1784184949.452060:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265484288 00000100:00100000:2.0:1784184949.452080:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784184949.452085:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265484288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184949.452117:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265484288:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184949.452122:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784184949.452160:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265484288:0@lo:400:kworker.0 00000100:00100000:0.0:1784184949.452236:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265484928:12345-0@lo:400:kworker.0 Request processed in 396us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184949.452244:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784184949.452295:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184949.452310:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265485056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184949.452890:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184949.453053:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485056 00000100:00100000:3.0:1784184949.453059:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485056 00000100:00100000:3.0:1784184949.453092:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784184949.453099:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265485056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184949.453129:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184949.453174:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265485056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184949.453180:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784184949.454153:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265485056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184949.458245:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265484928:0@lo:400:kworker.0 00000001:00080000:1.0:1784184950.032933:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1784184950.282516:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184950.352463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184950.352507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184950.352542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184950.352579:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184950.352643:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234304 00000100:00100000:1.0:1784184950.352653:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234304 00000100:00100000:1.0:1784184950.352725:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234560 00000100:00100000:1.0:1784184950.352729:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234560 00000100:00100000:1.0:1784184950.352781:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:1.0:1784184950.352792:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239234304:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184950.352871:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239234304:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184950.352878:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:1.0:1784184950.352896:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:1.0:1784184950.352902:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239234560:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184950.352928:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239234560:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184950.352934:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00080000:3.0:1784184950.353371:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184950.353596:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234432 00000100:00100000:2.0:1784184950.353601:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234432 00000100:00100000:2.0:1784184950.353748:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1784184950.353756:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239234432:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184950.353810:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239234432:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 55us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184950.353817:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1784184950.353953:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234176 00000100:00100000:0.0:1784184950.353957:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234176 00000100:00100000:0.0:1784184950.353990:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 283 00000100:00100000:0.0:1784184950.353996:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239234176:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184950.354027:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239234176:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184950.354033:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 283 00000100:00080000:3.0:1784184950.365378:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784184950.988745:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784184950.988798:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265485184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184950.988870:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184950.989154:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485184 00000100:00100000:3.0:1784184950.989162:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485184 00000100:00100000:3.0:1784184950.989246:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784184950.989256:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265485184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184950.989296:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184950.989371:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265485184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184950.989388:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1784184950.989696:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f84466a00 x1870853265485184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184950.989726:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265485184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784184951.308598:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184952.331451:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184953.354595:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184954.378518:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184954.571598:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265485312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184954.571670:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184954.572102:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485312 00000100:00100000:3.0:1784184954.572111:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485312 00000100:00100000:3.0:1784184954.572221:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784184954.572232:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265485312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184954.572272:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184954.572320:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265485312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184954.572327:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784184954.572445:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1784184954.572451:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fbb0fea00, transno 4294967300 00000100:00100000:1.0:1784184954.572477:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265485312:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784184954.573277:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784184954.574987:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265485824:0@lo:400:kworker.0 00000100:00100000:1.0:1784184954.575057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184954.575128:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784184954.575135:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265485440:0@lo:400:kworker.0 00000100:00100000:1.0:1784184954.575165:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184954.575200:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265485952:0@lo:400:kworker.0 00000100:00100000:1.0:1784184954.575227:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184954.575259:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485440 00000100:00100000:1.0:1784184954.575265:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485440 00000100:00100000:1.0:1784184954.575304:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1784184954.575313:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265485440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184954.575422:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265485440:12345-0@lo:400:kworker.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184954.575430:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1784184954.575475:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485952 00000100:00100000:1.0:1784184954.575479:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485952 00000100:00100000:1.0:1784184954.575512:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784184954.575519:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265485952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184954.575552:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265485952:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184954.575559:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784184954.575592:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265485440:0@lo:400:kworker.0 00000100:00100000:1.0:1784184954.575605:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265485952:0@lo:400:kworker.0 00000100:00100000:0.0:1784184954.575685:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485824 00000100:00100000:0.0:1784184954.575689:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485824 00000100:00100000:0.0:1784184954.575741:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784184954.575748:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265485824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184954.575925:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265485824:12345-0@lo:400:kworker.0 Request processed in 176us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184954.575932:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784184954.576002:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265485568:0@lo:400:kworker.0 00000100:00100000:3.0:1784184954.576032:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184954.576058:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784184954.576063:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265485696:0@lo:400:kworker.0 00000100:00100000:3.0:1784184954.576082:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184954.576142:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485568 00000100:00100000:0.0:1784184954.576147:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485568 00000100:00100000:0.0:1784184954.576176:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265485696 00000100:00100000:0.0:1784184954.576180:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265485696 00000100:00100000:0.0:1784184954.576199:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784184954.576205:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265485568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184954.576244:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265485568:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184954.576250:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784184954.576263:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784184954.576269:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265485696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184954.576294:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265485696:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184954.576308:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784184954.576361:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265485696:0@lo:400:kworker.0 00000100:00100000:0.0:1784184954.576371:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265485568:0@lo:400:kworker.0 00000100:00080000:2.0:1784184954.576935:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784184954.576942:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784184954.577522:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f84464380 x1870853265485824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184954.577536:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265485824:0@lo:400:kworker.0 00010000:00010000:1.0:1784184955.402892:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184955.480456:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184955.480501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184955.480517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184955.480543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184955.480575:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234816 00000100:00100000:1.0:1784184955.480596:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234816 00000100:00100000:1.0:1784184955.480663:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235072 00000100:00100000:1.0:1784184955.480666:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235072 00000100:00100000:1.0:1784184955.480697:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1784184955.480707:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239234816:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184955.480782:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239234816:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184955.480789:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1784184955.480805:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:1.0:1784184955.480812:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239235072:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184955.480837:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239235072:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184955.480843:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:1.0:1784184955.480863:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234944 00000100:00100000:1.0:1784184955.480866:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234944 00000100:00100000:1.0:1784184955.480894:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1784184955.480901:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239234944:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184955.480934:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239234944:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184955.480941:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00080000:1.0:1784184955.480957:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784184955.480972:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184955.481462:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239234688 00000100:00100000:3.0:1784184955.481467:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239234688 00000100:00100000:3.0:1784184955.481506:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 285 00000100:00100000:3.0:1784184955.481514:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239234688:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184955.481556:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239234688:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 43us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184955.481570:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 285 00000100:00100000:3.0:1784184956.110714:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265486080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784184956.110792:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184956.112018:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486080 00000100:00100000:0.0:1784184956.112031:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486080 00000100:00100000:0.0:1784184956.114054:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784184956.114070:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265486080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184956.114120:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184956.114363:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265486080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 298us (3570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184956.114372:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1784184956.115916:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f84466680 x1870853265486080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184956.115944:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265486080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784184956.121728:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784184956.428297:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184957.450574:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184958.474683:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784184958.926225:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784184959.498466:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184959.691372:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265486208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184959.691449:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184959.692221:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486208 00000100:00100000:3.0:1784184959.692230:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486208 00000100:00100000:3.0:1784184959.692301:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784184959.692311:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265486208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184959.692372:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184959.692426:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265486208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184959.692433:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1784184959.692629:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784184959.693382:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265486336:0@lo:400:kworker.0 00000100:00100000:2.0:1784184959.693440:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184959.693494:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265486848:0@lo:400:kworker.0 00000100:00100000:2.0:1784184959.693518:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184959.693550:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784184959.693556:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265486464:0@lo:400:kworker.0 00000100:00100000:2.0:1784184959.693582:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184959.693886:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486336 00000100:00100000:1.0:1784184959.693895:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486336 00000100:00100000:1.0:1784184959.693933:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1784184959.693941:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265486336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.693993:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265486336:12345-0@lo:400:kworker.0 Request processed in 52us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184959.694000:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1784184959.694050:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265486720:0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694077:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184959.694124:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265486208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184959.694142:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784184959.694148:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265486592:0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694173:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184959.694197:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486848 00000100:00100000:1.0:1784184959.694201:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486848 00000100:00100000:1.0:1784184959.694233:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486464 00000100:00100000:1.0:1784184959.694249:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486464 00000100:00100000:1.0:1784184959.694263:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486592 00000100:00100000:1.0:1784184959.694265:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486592 00000100:00100000:1.0:1784184959.694277:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784184959.694282:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265486848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694312:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265486848:12345-0@lo:400:kworker.0 Request processed in 30us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184959.694318:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784184959.694358:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784184959.694364:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265486464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694392:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265486464:12345-0@lo:400:kworker.0 Request processed in 29us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184959.694398:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784184959.694408:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784184959.694414:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265486592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694443:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265486592:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184959.694449:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1784184959.694475:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184959.694492:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265486592:0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694524:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265486464:0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694533:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265486336:0@lo:400:kworker.0 00000100:00100000:1.0:1784184959.694542:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265486848:0@lo:400:kworker.0 00000100:00100000:0.0:1784184959.695793:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486720 00000100:00100000:0.0:1784184959.695803:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486720 00000100:00100000:0.0:1784184959.695874:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784184959.695882:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265486720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184959.695947:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265486720:12345-0@lo:400:kworker.0 Request processed in 66us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184959.695953:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1784184959.696001:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbb0fce00 x1870853265486720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184959.696013:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265486720:0@lo:400:kworker.0 00000100:00080000:2.0:1784184959.696166:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784184960.524355:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184960.594183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184960.594242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184960.594389:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235200 00000100:00100000:2.0:1784184960.594398:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235200 00000100:00100000:2.0:1784184960.594454:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 287 00000100:00100000:2.0:1784184960.594465:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239235200:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184960.594546:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239235200:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184960.594554:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 287 00000100:00100000:3.0:1784184960.594945:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235328 00000100:00100000:3.0:1784184960.594950:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235328 00000100:00100000:3.0:1784184960.595001:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:3.0:1784184960.595010:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239235328:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184960.595050:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239235328:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 42us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184960.595057:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00080000:2.0:1784184960.595249:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184960.626246:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184960.626299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184960.626513:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235456 00000100:00100000:2.0:1784184960.626524:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235456 00000100:00100000:2.0:1784184960.626624:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1784184960.626635:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2352:x1870853239235456:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:2.0:1784184960.626668:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8b0150 00000100:00080000:2.0:1784184960.626678:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9b5f872a9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784184960.626715:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1784184960.626988:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+2:2352:x1870853239235456:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 354us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184960.626997:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:2.0:1784184960.627018:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184960.627558:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235584 00000100:00100000:3.0:1784184960.627566:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235584 00000100:00100000:3.0:1784184960.627645:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1784184960.627655:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239235584:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184960.627715:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2354:x1870853239235584:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 61us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184960.627722:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00080000:1.0:1784184960.627983:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784184960.627987:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784184961.231913:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265486976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784184961.231988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184961.232557:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265486976 00000100:00100000:3.0:1784184961.232567:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265486976 00000100:00100000:3.0:1784184961.232667:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784184961.232678:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265486976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184961.232717:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184961.232767:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265486976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184961.232774:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1784184961.232985:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784184961.233020:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f84465f80 x1870853265486976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184961.233039:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265486976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784184961.546885:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184962.570883:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184963.594512:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184964.624594:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184964.810559:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784184964.810689:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265487360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184964.810759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184964.810818:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265487360 00000100:00100000:3.0:1784184964.810824:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265487360 00000100:00100000:3.0:1784184964.810864:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784184964.810880:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265487360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184964.810908:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184964.810939:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265487360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184964.810944:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1784184964.810980:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784184964.811006:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265487360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184964.814175:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184964.814206:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265487232:0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.814280:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184964.816480:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265487232 00000100:00100000:3.0:1784184964.816496:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265487232 00000100:00100000:3.0:1784184964.816577:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784184964.816588:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265487232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184964.816695:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265487232:12345-0@lo:400:kworker.0 Request processed in 109us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184964.816703:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784184964.817176:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265487232:0@lo:400:kworker.0 00000100:00100000:2.0:1784184964.817632:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265487104:0@lo:400:kworker.0 00000100:00100000:2.0:1784184964.817701:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184964.817833:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265487104 00000100:00100000:3.0:1784184964.817839:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265487104 00000100:00100000:3.0:1784184964.817881:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1784184964.817889:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265487104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184964.817940:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265487104:12345-0@lo:400:kworker.0 Request processed in 52us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184964.817946:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784184964.818141:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265487104:0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.818731:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265487616:0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.818768:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184964.818794:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784184964.818800:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265487744:0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.818820:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184964.818840:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265487616 00000100:00100000:0.0:1784184964.818844:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265487616 00000100:00100000:0.0:1784184964.818884:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784184964.818890:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265487616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.818916:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265487616:12345-0@lo:400:kworker.0 Request processed in 27us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184964.818920:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784184964.818935:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265487744 00000100:00100000:0.0:1784184964.818937:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265487744 00000100:00100000:0.0:1784184964.819044:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784184964.819050:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265487744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.819072:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265487744:12345-0@lo:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184964.819075:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1784184964.819092:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784184964.819095:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784184964.819121:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265487744:0@lo:400:kworker.0 00010000:00080000:0.0:1784184964.819135:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbb0fe300 x1870853265487616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184964.819675:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265487616:0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.819717:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784184964.819726:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265487488:0@lo:400:kworker.0 00000100:00100000:0.0:1784184964.819758:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184964.820055:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265487488 00000100:00100000:3.0:1784184964.820060:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265487488 00000100:00100000:3.0:1784184964.820198:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784184964.820207:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265487488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184964.820267:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265487488:12345-0@lo:400:kworker.0 Request processed in 61us (508us total) trans 0 rc 0/0 00000100:00080000:0.0:1784184964.820304:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184964.820415:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265487488:0@lo:400:kworker.0 00000100:00100000:3.0:1784184964.826611:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000001:00100000:0.0:1784184965.451566:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:0.0:1784184965.451576:0:7506:0:(genops.c:906:class_export_put()) final put ffff9b5f872aa000/89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:0.0:1784184965.452880:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f872aa000/89741aef-63f5-4e1f-9ce7-defb19b62903 for lustre-OST0001 00000020:00000080:0.0:1784184965.452965:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f872a9800 for lustre-OST0001 00010000:00010000:3.0:1784184965.644963:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184965.712546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184965.712604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184965.712644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184965.712710:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235968 00000100:00100000:2.0:1784184965.712720:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235968 00000100:00100000:3.0:1784184965.712744:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235840 00000100:00100000:3.0:1784184965.712748:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235840 00000100:00100000:0.0:1784184965.712823:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239235712 00000100:00100000:0.0:1784184965.712827:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239235712 00000100:00100000:0.0:1784184965.712865:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 289 00000100:00100000:0.0:1784184965.712875:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239235712:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184965.712947:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239235712:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 72us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184965.712954:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 289 00000100:00080000:1.0:1784184965.713129:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184965.713671:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:2.0:1784184965.713681:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239235968:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184965.713740:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239235968:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 62us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184965.713746:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:3.0:1784184965.719251:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:3.0:1784184965.719270:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2355:x1870853239235840:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184965.719394:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2355:x1870853239235840:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 131us (6748us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184965.719402:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:3.0:1784184966.353564:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265487872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784184966.353632:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184966.353718:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265487872 00000100:00100000:3.0:1784184966.353726:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265487872 00000100:00100000:3.0:1784184966.353782:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784184966.353792:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265487872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184966.353827:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184966.353872:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265487872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184966.353879:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1784184966.353898:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784184966.353927:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fc13b7100 x1870853265487872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184966.353944:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265487872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784184966.671120:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184967.692193:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784184968.140152:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784184968.716929:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784184969.740380:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784184969.779822:0:11711:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:56:08 (1784184968) 00000100:00100000:1.0:1784184969.934839:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265488384:0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.934916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184969.934923:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265488000:0@lo:400:kworker.0 00000100:00100000:3.0:1784184969.934958:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184969.934979:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265488512:0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.934982:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265488128:0@lo:400:kworker.0 00000100:00100000:3.0:1784184969.935003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184969.935011:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488384 00000100:00100000:1.0:1784184969.935018:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488384 00000100:00100000:1.0:1784184969.935095:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784184969.935104:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265488384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935157:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265488384:12345-0@lo:400:kworker.0 Request processed in 55us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184969.935164:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1784184969.935183:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184969.935194:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184969.935212:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265488640:0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935231:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184969.935249:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784184969.935254:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265488256:0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935272:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184969.935294:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488512 00000100:00100000:1.0:1784184969.935297:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488512 00000100:00100000:1.0:1784184969.935325:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488128 00000100:00100000:1.0:1784184969.935327:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488128 00000100:00100000:1.0:1784184969.935367:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488256 00000100:00100000:1.0:1784184969.935370:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488256 00000100:00100000:1.0:1784184969.935384:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784184969.935401:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265488512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935433:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265488512:12345-0@lo:400:kworker.0 Request processed in 43us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184969.935460:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784184969.935473:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784184969.935480:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265488128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935512:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265488128:12345-0@lo:400:kworker.0 Request processed in 34us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184969.935518:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784184969.935529:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784184969.935536:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265488256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935578:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265488256:12345-0@lo:400:kworker.0 Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184969.935584:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784184969.935600:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488640 00000100:00100000:1.0:1784184969.935603:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488640 00000100:00100000:1.0:1784184969.935624:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784184969.935630:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265488640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935658:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265488640:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184969.935664:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1784184969.935684:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784184969.935688:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184969.935724:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265488256:0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935735:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265488128:0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.935743:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265488640:0@lo:400:kworker.0 00010000:00080000:1.0:1784184969.935774:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbd0000 x1870853265488384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784184985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784184969.935791:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265488384:0@lo:400:kworker.0 00000100:00100000:3.0:1784184969.936009:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265488512:0@lo:400:kworker.0 00000100:00100000:2.0:1784184969.936314:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488000 00000100:00100000:2.0:1784184969.936320:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488000 00000100:00100000:2.0:1784184969.936363:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784184969.936370:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265488000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184969.936421:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265488000:12345-0@lo:400:kworker.0 Request processed in 50us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184969.936426:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784184969.936474:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265488000:0@lo:400:kworker.0 00000100:00100000:1.0:1784184969.940256:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265488768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184969.940350:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184969.940470:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488768 00000100:00100000:2.0:1784184969.940478:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488768 00000100:00100000:2.0:1784184969.940530:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784184969.940549:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265488768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184969.940582:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184969.951956:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265488768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11398us (11614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184969.952618:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784184969.953585:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265488768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784184970.762731:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184970.830561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184970.830628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184970.830663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184970.830703:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239236352 00000100:00100000:2.0:1784184970.830704:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239236224 00000100:00100000:3.0:1784184970.830712:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239236352 00000100:00100000:2.0:1784184970.830712:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239236224 00000100:00100000:2.0:1784184970.830778:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 140 00000100:00100000:1.0:1784184970.830809:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239236096 00000100:00100000:1.0:1784184970.830813:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239236096 00000100:00100000:1.0:1784184970.830843:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 291 00000100:00100000:1.0:1784184970.830851:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239236096:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184970.830919:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239236096:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 68us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184970.830926:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 291 00000100:00080000:1.0:1784184970.830995:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184970.840945:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:3.0:1784184970.840959:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239236352:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184970.841060:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239236352:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 93us (10420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184970.841067:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:2.0:1784184970.843717:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239236224:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184970.843825:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239236224:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 13037us (13160us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184970.843836:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 140 00000100:00100000:2.0:1784184971.469197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784184971.469231:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265488896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784184971.469309:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184971.472812:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265488896 00000100:00100000:0.0:1784184971.472828:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265488896 00000100:00100000:0.0:1784184971.472923:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784184971.472933:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265488896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184971.472971:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184971.473065:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265488896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184971.473071:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1784184971.474200:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5f85ee0380 x1870853265488896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784184987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784184971.474240:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265488896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784184971.474268:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784184971.789959:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184972.243808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184972.243982:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239236480 00000100:00100000:1.0:1784184972.243993:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239236480 00000100:00100000:1.0:1784184972.244080:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1784184972.244092:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:10229:x1870853239236480:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784184972.244112:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184972.244138:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b021b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e41 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184972.244205:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0222 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184972.244219:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184972.244250:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184972.244535:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784184972.244540:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784184972.244636:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184972.244665:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b021b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e41 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184972.244682:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0222 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e41 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184972.244690:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8c4f5600) 00010000:00010000:1.0:1784184972.244694:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784184972.244697:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9600, rc 0) 00000100:00100000:1.0:1784184972.244759:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:10229:x1870853239236480:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 669us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184972.244766:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00080000:2.0:1784184972.245520:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184972.259850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184972.260456:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239236608 00000100:00100000:2.0:1784184972.260467:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239236608 00000100:00100000:2.0:1784184972.260534:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1784184972.260544:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:10230:x1870853239236608:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784184972.260581:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184972.260603:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0229 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.260664:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.260679:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.260690:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.260704:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.260711:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.260718:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.261104:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b023e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.261113:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b023e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.261121:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b023e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184972.261203:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784184972.261211:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184972.262149:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b023e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262165:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262172:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262178:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262183:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184972.262187:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262194:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262207:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8c4f5600) 00010000:00010000:2.0:1784184972.262210:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184972.262214:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262219:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262232:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262237:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262256:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262260:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971e00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184972.262263:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262269:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262435:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b5f8296e800) 00010000:00010000:2.0:1784184972.262438:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184972.262441:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262447:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0237 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262485:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0229 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e48 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262497:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b023e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e48 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.262504:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b5f8296ec00) 00010000:00010000:2.0:1784184972.262506:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784184972.262508:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970a00, rc 0) 00000100:00100000:2.0:1784184972.262579:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:10230:x1870853239236608:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2036us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184972.262595:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1784184972.284981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184972.285103:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239236864 00000100:00100000:2.0:1784184972.285114:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239236864 00000100:00100000:2.0:1784184972.285176:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1784184972.285186:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:10230:x1870853239236864:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784184972.285207:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184972.285229:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0245 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e4f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.285300:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.285314:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.285325:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.285450:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.285458:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.285466:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.285981:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169800/0x63160f6fbe8b025a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286003:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169800/0x63160f6fbe8b025a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286011:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169800/0x63160f6fbe8b025a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184972.286021:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1784184972.286227:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286235:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286242:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286248:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971e00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184972.286252:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286259:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286271:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b5f8296ec00) 00010000:00010000:2.0:1784184972.286273:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184972.286293:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286299:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b024c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286309:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286320:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286327:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286372:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184972.286375:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286381:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286390:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b5f8296e800) 00010000:00010000:2.0:1784184972.286392:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184972.286395:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286401:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0253 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286777:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0245 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e4f expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286792:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169800/0x63160f6fbe8b025a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e4f expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184972.286800:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:2.0:1784184972.286802:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184972.286810:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc2169800, rc 0) 00000100:00100000:2.0:1784184972.286885:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10230:x1870853239236864:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1700us (1912us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784184972.286893:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:0.0:1784184972.298632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184972.298773:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239236992 00000100:00100000:1.0:1784184972.298783:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239236992 00000100:00100000:1.0:1784184972.298844:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1784184972.298854:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10230:x1870853239236992:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784184972.298967:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10230:x1870853239236992:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 115us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184972.298992:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00010000:00010000:3.0:1784184972.817066:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784184973.260543:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784184973.834745:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184974.596200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184974.597096:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239237120 00000100:00100000:2.0:1784184974.597111:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239237120 00000100:00100000:2.0:1784184974.597312:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:2.0:1784184974.597325:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10272:x1870853239237120:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184974.597370:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184974.597408:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b0268 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e56 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.597493:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.597511:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.597526:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.597542:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.597549:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.597557:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600080:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600101:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600109:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600116:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2168400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184974.600120:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600129:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600156:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8c4f5600) 00010000:00010000:2.0:1784184974.600160:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184974.600166:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600173:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b026f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600191:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600198:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600205:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600217:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2169400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184974.600220:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600226:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600233:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b5f8296e800) 00010000:00010000:2.0:1784184974.600235:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184974.600238:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600244:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0276 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600298:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b0268 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e56 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600310:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8c4f5600) 00010000:00010000:2.0:1784184974.600312:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184974.600316:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b0268 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e56 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.600325:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc2168200, rc 0) 00000100:00100000:2.0:1784184974.600586:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10272:x1870853239237120:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 3262us (4397us total) trans 0 rc 301/301 00000100:00100000:2.0:1784184974.600598:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00080000:1.0:1784184974.601455:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184974.613559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184974.614085:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239237376 00000100:00100000:3.0:1784184974.614098:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239237376 00000100:00100000:3.0:1784184974.614227:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1784184974.614239:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10272:x1870853239237376:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:3.0:1784184974.614315:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184974.614382:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0222 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e41 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.614405:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8c4f5600) 00010000:00010000:3.0:1784184974.614418:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184974.614758:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.614773:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.614795:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.614809:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.614817:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.614824:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184974.620488:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784184974.620514:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.620527:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.620536:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.620543:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184974.620549:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.620555:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.620573:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f93b83400) 00010000:00010000:2.0:1784184974.620576:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184974.620580:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.620585:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b027d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784184974.620602:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057573637 reply state 000000008d5a5907 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184974.620609:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784184974.620755:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+10:10272:x1870853239237376:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 6512us (7204us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784184974.620766:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00010000:00010000:1.0:1784184974.625048:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.625070:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.625080:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.625088:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184974.625094:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.625103:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.625127:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b5f93b83e00) 00010000:00010000:1.0:1784184974.625130:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184974.625136:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.625143:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0284 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184974.713676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184974.713944:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239237504 00000100:00100000:0.0:1784184974.713958:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239237504 00000100:00100000:0.0:1784184974.714064:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1784184974.714084:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10280:x1870853239237504:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:0.0:1784184974.714138:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184974.714190:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b028b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e5d expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.714393:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0292 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.714422:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.714443:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184974.714531:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784184974.714536:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184974.714770:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0292 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.714805:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b028b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e5d expref: 11 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.714982:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0292 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e5d expref: 10 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.714994:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:0.0:1784184974.715106:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784184974.715117:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ca00, rc 0) 00000100:00100000:0.0:1784184974.717530:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+10:10280:x1870853239237504:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 3436us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184974.717546:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1784184974.799305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184974.799830:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239237632 00000100:00100000:2.0:1784184974.799846:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239237632 00000100:00100000:2.0:1784184974.799938:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1784184974.799951:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+10:10286:x1870853239237632:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784184974.799980:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184974.800010:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b0299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800099:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800117:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800255:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800277:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800284:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800292:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800485:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b02ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800494:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b02ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800521:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b02ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184974.800566:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1784184974.800571:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184974.800693:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b02ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800709:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800715:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800721:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800727:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2169400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184974.800732:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800742:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800757:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:2.0:1784184974.800760:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184974.800766:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800772:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b02a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800800:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800807:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800812:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800817:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2168400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184974.800820:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800825:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800833:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b5f8296e800) 00010000:00010000:2.0:1784184974.800835:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184974.800838:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800843:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b02a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800881:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b0299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e64 expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800896:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b02ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e64 expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.800913:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184974.800916:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784184974.800918:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc2169000, rc 0) 00000100:00100000:2.0:1784184974.801070:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+11:10286:x1870853239237632:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1121us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184974.801081:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1784184974.805656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184974.805759:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239237888 00000100:00100000:2.0:1784184974.805772:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239237888 00000100:00100000:2.0:1784184974.805844:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1784184974.805854:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+11:10286:x1870853239237888:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784184974.805880:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184974.805909:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b02b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e6b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.806096:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.806113:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.806126:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.807732:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.807758:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.807792:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784184974.812177:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1784184974.812593:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812611:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812627:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812666:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812684:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812691:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812696:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184974.812701:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812707:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812719:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184974.812721:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184974.812737:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812744:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b02bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784184974.812757:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004eb241db reply state 000000003aae8e54 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184974.812765:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784184974.812804:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b02b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.812819:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184974.813136:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:2.0:1784184974.813141:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184974.813144:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc2168200, rc 0) 00000100:00100000:2.0:1784184974.813226:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10286:x1870853239237888:12345-192.168.201.29@tcp:101:bash.0 Request processed in 7372us (7581us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784184974.813235:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00010000:00010000:3.0:1784184974.818853:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184974.818874:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1784184974.818880:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.818891:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.818899:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971e00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184974.818906:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.818915:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184974.818944:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296e800) 00010000:00010000:3.0:1784184974.818968:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184974.818975:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184974.818978:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239238016 00000100:00100000:1.0:1784184974.818996:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239238016 00010000:00010000:3.0:1784184974.819019:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b02c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184974.819057:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1784184974.819067:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1870853239238016:12345-192.168.201.29@tcp:8:bash.0 00010000:00080000:1.0:1784184974.819114:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:1.0:1784184974.819144:0:6590:0:(genops.c:1406:class_connect()) connect: client 89741aef-63f5-4e1f-9ce7-defb19b62903, cookie 0x63160f6fbe8b02d8 00002000:00100000:1.0:1784184974.819156:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 89741aef-63f5-4e1f-9ce7-defb19b62903/ffff9b5f83389800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784184974.819180:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784184974.819460:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784184974.819496:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9b5f8338d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784184974.819564:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2352:x1870853239238016:12345-192.168.201.29@tcp:8:bash.0 Request processed in 495us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184974.819572:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1784184974.823989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184974.824400:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239238144 00000100:00100000:0.0:1784184974.824416:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239238144 00000100:00100000:0.0:1784184974.824509:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1784184974.824525:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:0:x1870853239238144:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784184974.824544:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184974.824570:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e72 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784184974.824601:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784184974.824622:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1784184974.824627:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184974.824638:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784184974.824657:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784184974.824665:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.824692:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d600, rc 0) 00000100:00100000:0.0:1784184974.824777:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:0:x1870853239238144:12345-192.168.201.29@tcp:101:bash.0 Request processed in 255us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184974.824790:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1784184974.837876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184974.838822:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239238272 00000100:00100000:1.0:1784184974.838837:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239238272 00000100:00100000:1.0:1784184974.841060:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:1.0:1784184974.841090:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:10286:x1870853239238272:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1784184974.841114:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184974.841143:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e79 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.841187:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.841198:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784184974.841203:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784184974.841210:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.841255:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.841289:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 8 pid: 6588 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184974.841306:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1870853265489024:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784184974.841475:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184974.856430:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184974.856532:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239238400 00000100:00100000:0.0:1784184974.856545:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239238400 00010000:00010000:0.0:1784184974.856601:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 9 pid: 6588 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184974.856657:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:0.0:1784184974.856668:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239238400:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184974.856688:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184974.856720:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 9 pid: 6588 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.856738:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 9 pid: 6588 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.856773:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184974.856779:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184974.856789:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.856801:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184974.856853:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184974.856869:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84466d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1870853265489152:192.168.201.29@tcp:105: 00000100:00100000:0.0:1784184974.856994:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af480 going to sleep for 11 seconds 00010000:00010000:1.0:1784184974.857319:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090a1ad79/0x63160f6fbe8b02df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e72 expref: 9 pid: 6588 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184974.857443:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1870853265489024:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784184974.857475:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184974.857488:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8e00, rc 0) 00000100:00100000:0.0:1784184974.857649:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+8:10286:x1870853239238272:12345-192.168.201.29@tcp:101:bash.0 Request processed in 16573us (19786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184974.857659:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00010000:00010000:0.0:1784184974.858543:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184974.859559:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84466d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1870853265489152:192.168.201.29@tcp:105: 00010000:00010000:0.0:1784184974.859588:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184974.859670:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239238400:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 3002us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184974.859681:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1784184974.873194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184974.873783:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239238656 00000100:00100000:2.0:1784184974.873797:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239238656 00000100:00100000:2.0:1784184974.873872:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1784184974.873883:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10286:x1870853239238656:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1784184974.874440:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10286:x1870853239238656:12345-192.168.201.29@tcp:35:bash.0 Request processed in 557us (1261us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784184974.874456:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1784184975.012103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.012407:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239238912 00000100:00100000:1.0:1784184975.012425:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239238912 00000100:00100000:1.0:1784184975.012519:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1784184975.012531:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10296:x1870853239238912:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184975.012565:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184975.012596:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b02ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e80 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184975.012884:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1784184975.013117:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b02ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e80 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.013163:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:1.0:1784184975.013167:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784184975.013173:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b02ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e80 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.013192:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9c00, rc 0) 00000100:00100000:1.0:1784184975.013470:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+15:10296:x1870853239238912:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 933us (1377us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1784184975.013480:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:0.0:1784184975.031835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.032492:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239239168 00000100:00100000:2.0:1784184975.032508:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239239168 00000100:00100000:2.0:1784184975.032593:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1784184975.032605:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+15:10296:x1870853239239168:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1784184975.033002:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:10296:x1870853239239168:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 398us (1181us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784184975.033011:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1784184975.050777:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265489408:0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.050877:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184975.050961:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265489920:0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.051002:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184975.051043:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784184975.051049:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265489536:0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.051087:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184975.051121:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265489920 00000100:00100000:3.0:1784184975.051130:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265489920 00000100:00100000:3.0:1784184975.051205:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784184975.051217:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265489920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.051279:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265489920:12345-0@lo:400:kworker.0 Request processed in 64us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184975.051288:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1784184975.051315:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784184975.051387:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265489920:0@lo:400:kworker.0 00000100:00100000:0.0:1784184975.051739:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265489408 00000100:00100000:0.0:1784184975.051745:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265489408 00000100:00100000:0.0:1784184975.051791:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265489536 00000100:00100000:0.0:1784184975.051795:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265489536 00000100:00100000:0.0:1784184975.051826:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784184975.051834:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265489408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184975.051888:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265489408:12345-0@lo:400:kworker.0 Request processed in 55us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184975.051894:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784184975.051910:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784184975.051917:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265489536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184975.051945:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265489536:12345-0@lo:400:kworker.0 Request processed in 29us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184975.051950:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1784184975.052191:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184975.052219:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265489536:0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.052254:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265489408:0@lo:400:kworker.0 00000100:00100000:1.0:1784184975.052372:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265489664:0@lo:400:kworker.0 00000100:00100000:1.0:1784184975.052415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184975.052458:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784184975.052466:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265489280:0@lo:400:kworker.0 00000100:00100000:1.0:1784184975.052495:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184975.052526:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265489792:0@lo:400:kworker.0 00000100:00100000:1.0:1784184975.052549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184975.052694:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265489792 00000100:00100000:2.0:1784184975.052699:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265489792 00000100:00080000:2.0:1784184975.052722:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184975.052748:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784184975.052756:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265489792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184975.052802:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265489792:12345-0@lo:400:kworker.0 Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184975.052809:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784184975.052836:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265489792:0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.052960:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265489280 00000100:00100000:3.0:1784184975.052965:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265489280 00000100:00100000:3.0:1784184975.053080:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1784184975.053088:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265489280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.053127:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265489280:12345-0@lo:400:kworker.0 Request processed in 41us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184975.053134:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1784184975.053415:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265489280:0@lo:400:kworker.0 00000100:00100000:0.0:1784184975.053520:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265489664 00000100:00100000:0.0:1784184975.053531:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265489664 00000100:00100000:0.0:1784184975.053581:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784184975.053587:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265489664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184975.053903:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265489664:12345-0@lo:400:kworker.0 Request processed in 316us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184975.053911:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784184975.054074:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265489664:0@lo:400:kworker.0 00000100:00100000:3.0:1784184975.054187:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f88b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265490048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184975.054228:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784184975.054312:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784184975.054374:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265490048 00000100:00100000:0.0:1784184975.054379:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265490048 00000100:00100000:0.0:1784184975.054414:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784184975.054422:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265490048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784184975.054476:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184975.054518:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265490048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184975.054525:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784184975.054636:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f88b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265490048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184975.154005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184975.154207:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239239296 00000100:00100000:3.0:1784184975.154221:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239239296 00000100:00100000:3.0:1784184975.154303:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1784184975.154315:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+16:10302:x1870853239239296:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784184975.154392:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184975.154423:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b02fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e87 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.154529:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.154547:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.154563:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184975.154840:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1784184975.154872:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784184975.154911:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.154947:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b02fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e87 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.154973:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e87 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.155090:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784184975.155094:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784184975.155098:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ec00, rc 0) 00000100:00100000:3.0:1784184975.155193:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+17:10302:x1870853239239296:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 880us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184975.155202:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1784184975.160293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.160523:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239239552 00000100:00100000:1.0:1784184975.160537:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239239552 00000100:00100000:1.0:1784184975.160616:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1784184975.160636:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+17:10302:x1870853239239552:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184975.160662:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184975.160689:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b0309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e8e expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.160832:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.160850:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.160873:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184975.160885:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784184975.161296:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b0309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e8e expref: 20 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.161317:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e8e expref: 19 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.161326:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:1.0:1784184975.161422:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784184975.161426:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9a00, rc 0) 00000100:00100000:1.0:1784184975.161592:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10302:x1870853239239552:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 958us (1311us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1784184975.161602:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1784184975.173292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184975.174674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.174791:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239239936 00000100:00100000:2.0:1784184975.174803:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239239936 00000100:00100000:2.0:1784184975.174881:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1784184975.174894:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+19:2353:x1870853239239936:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184975.174937:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184975.174971:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e8e expref: 19 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.174993:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:2.0:1784184975.175000:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184975.175082:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2353:x1870853239239936:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 190us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184975.175091:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1784184975.177117:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239239808 00000100:00100000:3.0:1784184975.177134:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239239808 00000100:00100000:2.0:1784184975.177411:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1784184975.177423:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:10302:x1870853239239808:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184975.177457:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184975.177497:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b031e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e95 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.177640:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0325 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.177659:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0325 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.177673:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0325 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184975.177689:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784184975.177856:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168400/0x63160f6fbe8b031e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e95 expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.177903:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0325 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e95 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.177913:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:2.0:1784184975.177916:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784184975.177921:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc2169400, rc 0) 00000100:00100000:2.0:1784184975.178001:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:10302:x1870853239239808:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 579us (4724us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1784184975.178010:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1784184975.186110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184975.186262:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239240064 00000100:00100000:3.0:1784184975.186275:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239240064 00000100:00100000:3.0:1784184975.186400:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1784184975.186412:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239240064:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:3.0:1784184975.186474:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.186769:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.186803:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784184975.186809:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784184975.186814:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.186971:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.186999:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 7 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184975.187029:0:10137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f88b91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10137:1870853265490176:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784184975.187162:0:10137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c853c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184975.191487:0:10137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f88b91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10137:1870853265490176:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184975.191530:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184975.192081:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.192224:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239240192 00000100:00100000:1.0:1784184975.192235:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239240192 00002000:00100000:1.0:1784184975.192296:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b5f84466a00 x1870853239240192/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:696/0 lens 504/0 e 0 to 0 dl 1784184986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784184975.192306:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f84466a00 with x1870853239240192 ext(0->12) 00010000:00010000:1.0:1784184975.192315:0:6594:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 8 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.192424:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 8 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784184975.192435:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5f84466a00 00000100:00100000:1.0:1784184975.192562:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1784184975.192575:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239240192:12345-192.168.201.29@tcp:4:lfs.0 00000001:00100000:3.0:1784184975.224499:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000100:00100000:0.0:1784184975.226829:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239240192:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 34241us (34734us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784184975.226856:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00002000:00100000:0.0:1784184975.226874:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b5f84466a00 x1870853239240192/t4294967299(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:696/0 lens 504/448 e 0 to 0 dl 1784184986 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784184975.226887:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f84466a00 with x1870853239240192 ext(0->12) 00010000:00010000:0.0:1784184975.226899:0:6594:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.226952:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784184975.226963:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5f84466a00 00000100:00100000:1.0:1784184975.231074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184975.231172:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239240320 00000100:00100000:3.0:1784184975.231187:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239240320 00010000:00010000:3.0:1784184975.231240:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184975.231358:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1784184975.231380:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2353:x1870853239240320:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184975.231402:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784184975.231428:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784184975.231431:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784184974 00002000:00010000:3.0:1784184975.231434:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784184974 00002000:00010000:3.0:1784184975.231436:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784184974 00010000:00010000:3.0:1784184975.231443:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.231494:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.231526:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000052a126/0x63160f6fbe8b02e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e79 expref: 9 pid: 6590 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.231547:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784184975.231552:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784184975.231558:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.231570:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.231611:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184975.231697:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239240320:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 320us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184975.231707:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00010000:00010000:1.0:1784184975.233408:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233432:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233488:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233521:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233531:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233539:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784184975.233545:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233556:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233584:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.233593:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d67f984/0x63160f6fbe8b0333 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184975.233736:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239240064:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 47321us (47634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184975.233748:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1784184975.237603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.237899:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239240576 00000100:00100000:2.0:1784184975.237913:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239240576 00000100:00100000:2.0:1784184975.238077:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1784184975.238089:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:10302:x1870853239240576:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:2.0:1784184975.238189:0:5795:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0325 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e95 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784184975.238957:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1784184975.239043:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1784184975.244291:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1784184975.244484:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.244513:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.244524:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.244595:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.244614:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 24 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184975.244865:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1870853265490304:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184975.245158:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8341a540 going to sleep for 11 seconds 00000100:00100000:0.0:1784184975.250167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184975.250455:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239240704 00000100:00100000:3.0:1784184975.250471:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239240704 00010000:00010000:3.0:1784184975.250524:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 25 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184975.250572:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1784184975.250583:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+25:2355:x1870853239240704:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184975.250619:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184975.250628:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 25 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.250644:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 25 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.250673:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:3.0:1784184975.250680:0:7492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.250690:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.250710:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184975.250738:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184975.250818:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+25:2355:x1870853239240704:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 235us (664us total) trans 0 rc 0/0 00010000:00010000:1.0:1784184975.251461:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2168200/0x63160f6fbe8b02ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186e6b expref: 25 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184975.251928:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1870853265490304:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784184975.251960:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.251971:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.252055:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784184975.252236:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1784184975.252678:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1784184975.252970:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f88b93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265490432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784184975.255516:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184975.255596:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f941b93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184975.255695:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265490432 00000100:00100000:2.0:1784184975.255712:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265490432 00000100:00100000:2.0:1784184975.255850:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784184975.255864:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1870853265490432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784184975.257270:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1870853265490432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1399us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184975.257285:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784184975.257309:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f88b93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265490432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784184975.259324:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1784184975.259527:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265490560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784184975.259630:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184975.259674:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8341af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784184975.260062:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265490560 00000100:00100000:0.0:1784184975.260072:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265490560 00000100:00100000:0.0:1784184975.260149:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784184975.260161:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5795:x1870853265490560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784184975.260466:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5795:x1870853265490560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 307us (846us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784184975.260487:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784184975.260556:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265490560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784184975.260640:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1784184975.260692:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.260706:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.260715:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.260722:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971c00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184975.260728:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.261123:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.261147:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:0.0:1784184975.261150:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784184975.261157:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.261164:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b033a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784184975.261706:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784184975.262271:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1784184975.262289:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373427956468ns, next at 374427953268ns, rc = 0 00000001:00080000:0.0:1784184975.262301:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1784184975.262576:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:0.0:1784184975.262581:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784184975.262592:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169400/0x63160f6fbe8b0325 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e95 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184975.262956:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+28:10302:x1870853239240576:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 24867us (25368us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1784184975.262968:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000020:00080000:0.0:1784184975.262975:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784184975.264168:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:0.0:1784184975.277781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.277938:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239240832 00000100:00100000:2.0:1784184975.277951:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239240832 00000100:00100000:2.0:1784184975.278077:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1784184975.278091:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+27:10302:x1870853239240832:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184975.278127:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184975.278160:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186e9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.278261:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e9c expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.278280:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e9c expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.278304:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184975.278309:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784184975.278314:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971e00, rc 0) 00000100:00100000:2.0:1784184975.278449:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+28:10302:x1870853239240832:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 362us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184975.278457:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1784184975.285541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.285656:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239241088 00000100:00100000:1.0:1784184975.285669:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239241088 00000100:00100000:1.0:1784184975.285739:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1784184975.285752:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa0560450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+28:10302:x1870853239241088:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184975.286121:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa0560450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10302:x1870853239241088:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 370us (592us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1784184975.286129:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784184975.395026:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.395171:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239241344 00000100:00100000:2.0:1784184975.395183:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239241344 00000100:00100000:2.0:1784184975.395263:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:2.0:1784184975.395276:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10312:x1870853239241344:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184975.395311:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184975.395389:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ea3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184975.395541:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784184975.395693:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0348 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ea3 expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.395711:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:2.0:1784184975.395731:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784184975.395739:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b0348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ea3 expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.395756:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971a00, rc 0) 00000100:00100000:2.0:1784184975.395832:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10312:x1870853239241344:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 559us (823us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1784184975.395840:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:2.0:1784184975.403090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.403211:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239241472 00000100:00100000:1.0:1784184975.403222:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239241472 00000100:00100000:1.0:1784184975.403298:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1784184975.403326:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10312:x1870853239241472:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:1.0:1784184975.403484:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403506:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403520:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403537:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403545:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403552:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403692:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403701:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403708:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784184975.403897:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403915:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403932:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403940:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403948:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184975.403953:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403961:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403976:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:1.0:1784184975.403979:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184975.403985:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.403992:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404007:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404014:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404021:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404026:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184975.404037:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404043:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404052:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8c4f5000) 00010000:00010000:1.0:1784184975.404054:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184975.404057:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404063:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b035d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404079:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404085:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404092:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404097:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184975.404100:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404105:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404113:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:1.0:1784184975.404115:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184975.404124:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.404131:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184975.404379:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10312:x1870853239241472:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1010us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184975.404390:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1784184975.408726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.408942:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239241728 00000100:00100000:1.0:1784184975.408955:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239241728 00000100:00100000:1.0:1784184975.409038:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1784184975.409052:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10312:x1870853239241728:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184975.409442:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10312:x1870853239241728:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 390us (729us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1784184975.409451:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1784184975.457689:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.457927:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239241984 00000100:00100000:2.0:1784184975.457940:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239241984 00000100:00100000:2.0:1784184975.458230:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1784184975.458243:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10315:x1870853239241984:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184975.458277:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184975.458308:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b036b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186eaa expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.458483:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.458501:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.458516:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.458563:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.458572:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.458589:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.458963:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459039:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459050:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184975.459063:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784184975.459190:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459199:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459206:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459212:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971c00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184975.459218:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459226:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459239:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184975.459243:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184975.459259:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459265:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b0372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459281:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459288:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459293:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459298:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184975.459301:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459307:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459315:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296e800) 00010000:00010000:2.0:1784184975.459318:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184975.459320:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459326:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459426:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971a00/0x63160f6fbe8b036b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459453:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.459461:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184975.459464:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184975.459467:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c400, rc 0) 00000100:00100000:2.0:1784184975.459850:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10315:x1870853239241984:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1608us (2175us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1784184975.459861:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1784184975.464841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.464942:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239242112 00000100:00100000:1.0:1784184975.464955:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239242112 00000100:00100000:1.0:1784184975.465122:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1784184975.465134:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10315:x1870853239242112:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1784184975.465231:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465255:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465270:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465305:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465329:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465376:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465383:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184975.465389:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465397:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465411:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:1.0:1784184975.465414:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784184975.465419:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.465426:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b038e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184975.465518:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10315:x1870853239242112:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 386us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184975.465527:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1784184975.467481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184975.467593:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239242368 00000100:00100000:0.0:1784184975.467604:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239242368 00000100:00100000:0.0:1784184975.467693:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1784184975.467703:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10315:x1870853239242368:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784184975.468000:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+34:10315:x1870853239242368:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 297us (529us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1784184975.468008:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000001:00080000:3.0:1784184975.623725:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:3.0:1784184975.623746:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1784184975.624504:0:11824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5f8341a0c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1784184975.624510:0:11824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f82e25600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f8341a480 00000020:00080000:2.0:1784184975.624514:0:11824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f82e25c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fc1589c00 00000020:00080000:2.0:1784184975.624550:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1784184975.624940:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1784184975.625367:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265490688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784184975.628487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184975.629017:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265490688 00000100:00100000:2.0:1784184975.629037:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265490688 00000100:00100000:2.0:1784184975.629095:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784184975.629105:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265490688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784184975.629134:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1784184975.629170:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a58808e, atime: 0x6a58808e, ctime: 0x6a58808e, blocks: 0x1 00010000:00010000:2.0:1784184975.629178:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.629194:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1784184975.629210:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184975.629218:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.629232:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.629242:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.629249:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.629269:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784184975.632101:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265490688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2992us (3615us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784184975.632117:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1784184975.632150:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784184975.632159:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.632170:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784184975.632175:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.632186:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.632224:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.632232:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b0395 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.632255:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184975.632257:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184975.632258:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784184975.632488:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5f84466d80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1784184975.632495:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265490688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784184975.707719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.707814:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239242624 00000100:00100000:2.0:1784184975.707824:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239242624 00000100:00100000:2.0:1784184975.707885:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1784184975.707895:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+12:10346:x1870853239242624:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:2.0:1784184975.707918:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184975.707952:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b039c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186eb1 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.708057:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b03a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.708071:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b03a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.708081:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b03a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184975.708092:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784184975.708385:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b039c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb1 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.708404:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b03a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb1 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.708413:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184975.708416:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184975.708419:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d400, rc 0) 00000100:00100000:2.0:1784184975.708484:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10346:x1870853239242624:12345-192.168.201.29@tcp:101:cat.0 Request processed in 590us (774us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1784184975.708491:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1784184975.711806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184975.712471:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184975.712822:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239243008 00000100:00100000:0.0:1784184975.712832:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239243008 00000100:00100000:0.0:1784184975.712901:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1784184975.712912:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:2355:x1870853239243008:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184975.712928:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184975.712953:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b03a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb1 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.712985:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:0.0:1784184975.712991:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184975.713049:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2355:x1870853239243008:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 139us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184975.713056:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1784184975.714115:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239242880 00000100:00100000:1.0:1784184975.714137:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239242880 00000100:00100000:1.0:1784184975.714188:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1784184975.714197:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10346:x1870853239242880:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:1.0:1784184975.716777:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10346:x1870853239242880:12345-192.168.201.29@tcp:35:cat.0 Request processed in 2572us (4972us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1784184975.716790:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1784184975.797112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.797300:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239243264 00000100:00100000:2.0:1784184975.797313:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239243264 00000100:00100000:2.0:1784184975.797470:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:2.0:1784184975.797482:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10352:x1870853239243264:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:2.0:1784184975.797513:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184975.797516:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784184975.797555:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e87 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.797581:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184975.797587:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784184975.797605:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186eb8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.797728:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.797756:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.797764:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.797805:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.797820:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 14 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184975.797837:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265490816:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184975.798951:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8341ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1784184975.802725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.802797:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239243392 00000100:00100000:1.0:1784184975.802816:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239243392 00010000:00010000:1.0:1784184975.802871:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 15 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184975.802877:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265490816:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184975.802912:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184975.802927:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:1.0:1784184975.802938:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+15:2356:x1870853239243392:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184975.802956:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184975.802964:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 15 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.802977:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 15 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.803005:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eaa expref: 15 pid: 5792 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.803021:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:1.0:1784184975.803026:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.803059:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.803068:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184975.803102:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784184975.803131:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.803137:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184975.803173:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+14:2356:x1870853239243392:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 237us (473us total) trans 0 rc 0/0 00000004:00200000:2.0:1784184975.803179:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1784184975.803181:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00010000:00010000:2.0:1784184975.803542:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.803574:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.803580:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184975.803591:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784184975.803593:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158ce00, rc 0) 00000100:00100000:2.0:1784184975.803626:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10352:x1870853239243264:12345-192.168.201.29@tcp:101:dd.0 Request processed in 6140us (6522us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1784184975.803634:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1784184975.808496:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184975.808609:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239243648 00000100:00100000:2.0:1784184975.808620:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239243648 00000100:00100000:2.0:1784184975.808706:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:2.0:1784184975.808721:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10352:x1870853239243648:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:2.0:1784184975.809175:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.809193:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.809205:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784184975.809246:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1784184975.809263:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002af451a3 reply state 00000000b9e71db1 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184975.809270:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784184975.809430:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+17:10352:x1870853239243648:12345-192.168.201.29@tcp:36:dd.0 Request processed in 716us (951us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1784184975.809437:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000020:00080000:2.0:1784184975.809442:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784184975.812683:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.812707:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.812716:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.812723:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158de00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184975.812729:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.812738:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.812767:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184975.812771:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184975.812777:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184975.812783:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184975.891240:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184975.960104:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184975.960157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184975.960201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184975.960427:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239244032 00000100:00100000:1.0:1784184975.960441:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239244032 00000100:00100000:1.0:1784184975.960532:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:1.0:1784184975.960545:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239244032:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184975.960643:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239244032:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 100us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184975.960651:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:2.0:1784184975.960742:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239243776 00000100:00100000:2.0:1784184975.960748:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239243776 00000100:00100000:2.0:1784184975.960791:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 293 00000100:00100000:2.0:1784184975.960798:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239243776:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184975.960847:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239243776:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 50us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184975.960854:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 293 00000100:00100000:3.0:1784184975.961057:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239243904 00000100:00100000:3.0:1784184975.961061:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239243904 00000100:00100000:3.0:1784184975.961103:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1784184975.961111:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239243904:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784184975.961143:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239243904:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184975.961150:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00080000:0.0:1784184975.961379:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184976.070474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.070563:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239244160 00000100:00100000:2.0:1784184976.070577:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239244160 00000100:00100000:2.0:1784184976.070733:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:2.0:1784184976.070746:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:10366:x1870853239244160:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:2.0:1784184976.070775:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184976.070802:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ebf expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.070922:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.070940:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.070953:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.070970:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.070977:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.070984:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.071546:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.071569:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.071578:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.071620:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.071636:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 17 pid: 5793 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184976.071652:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265490944:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184976.071829:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8341ae40 going to sleep for 11 seconds 00000100:00080000:0.0:1784184976.072040:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184976.076646:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265490944:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184976.076694:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184976.077287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184976.077393:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239244416 00000100:00100000:0.0:1784184976.077402:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239244416 00000100:00100000:0.0:1784184976.077479:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1784184976.077491:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:5571:x1870853239244416:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784184976.078006:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:5571:x1870853239244416:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 516us (719us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1784184976.078017:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1784184976.079969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.080093:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239244544 00000100:00100000:2.0:1784184976.080102:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239244544 00010000:00010000:2.0:1784184976.080144:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 19 pid: 5793 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184976.080181:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1784184976.080188:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:2355:x1870853239244544:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184976.080202:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184976.080222:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 19 pid: 5793 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.080232:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 19 pid: 5793 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.080255:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b03b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186eb8 expref: 19 pid: 5793 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.080269:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184976.080274:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.080282:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.080288:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.080316:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184976.080409:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080419:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184976.080496:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2355:x1870853239244544:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 307us (535us total) trans 0 rc 0/0 00000004:00200000:0.0:1784184976.080497:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000100:00100000:2.0:1784184976.080503:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000004:00200000:0.0:1784184976.080503:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184976.080546:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080561:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080572:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080579:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080586:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080591:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184976.080604:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080613:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080798:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:0.0:1784184976.080804:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184976.080809:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080816:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b03d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080830:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080837:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080843:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080847:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184976.080850:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080856:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080865:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296e800) 00010000:00010000:0.0:1784184976.080867:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184976.080878:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080884:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b03db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080935:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b03cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ebf expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080952:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ebf expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.080959:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:0.0:1784184976.080962:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184976.080964:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158ca00, rc 0) 00000100:00100000:0.0:1784184976.081009:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+17:10366:x1870853239244160:12345-192.168.201.29@tcp:101:stat.0 Request processed in 10266us (10551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184976.081017:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1784184976.138058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184976.138254:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239244800 00000100:00100000:1.0:1784184976.138267:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239244800 00000100:00100000:1.0:1784184976.138505:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:1.0:1784184976.138534:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+17:10372:x1870853239244800:12345-192.168.201.29@tcp:36:truncate.0 00010000:00010000:1.0:1784184976.138666:0:7503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184976.138722:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b03e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ebf expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.138766:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:1.0:1784184976.138810:0:7503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784184976.139191:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.139208:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.139221:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784184976.139276:0:7503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1784184976.139303:0:7503:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce886e39 reply state 000000007635726d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184976.139314:0:7503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784184976.139528:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10372:x1870853239244800:12345-192.168.201.29@tcp:36:truncate.0 Request processed in 1011us (1484us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1784184976.139538:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000020:00080000:1.0:1784184976.139544:0:7503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784184976.145508:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.145532:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.145541:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.145549:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184976.145555:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.145584:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.145617:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:0.0:1784184976.145621:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184976.145627:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.145634:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b03e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184976.306323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184976.306881:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239244928 00000100:00100000:3.0:1784184976.306896:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239244928 00000100:00100000:3.0:1784184976.307224:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:3.0:1784184976.307237:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+18:10386:x1870853239244928:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:3.0:1784184976.307425:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184976.307469:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b03f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ec6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.307611:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.307638:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.307664:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.307693:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.307738:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.307746:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308473:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308486:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308509:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184976.308588:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1784184976.308594:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784184976.308653:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308676:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308686:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308702:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308710:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308730:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184976.308753:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308774:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308799:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784184976.308802:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184976.308808:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308827:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b03f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308855:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308861:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308868:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308885:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184976.308888:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308895:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308930:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f93b83d00) 00010000:00010000:3.0:1784184976.308932:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184976.308936:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.308943:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b03fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.309025:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b03f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.309054:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.309062:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:3.0:1784184976.309075:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784184976.309078:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ea00, rc 0) 00000100:00100000:3.0:1784184976.309219:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10386:x1870853239244928:12345-192.168.201.29@tcp:101:stat.0 Request processed in 1985us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184976.309244:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:3.0:1784184976.393065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.393412:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239245184 00000100:00100000:2.0:1784184976.393426:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239245184 00000100:00100000:2.0:1784184976.393507:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1784184976.393519:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10396:x1870853239245184:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184976.393744:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184976.393776:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b040c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ecd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184976.394136:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1784184976.394294:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b040c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ecd expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.394308:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:2.0:1784184976.394311:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784184976.394315:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b040c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ecd expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.394328:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c000, rc 0) 00000100:00100000:2.0:1784184976.394554:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+20:10396:x1870853239245184:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1024us (1491us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1784184976.394563:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1784184976.402560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184976.405456:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239245440 00000100:00100000:1.0:1784184976.405477:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239245440 00000100:00100000:1.0:1784184976.405571:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1784184976.405594:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+20:10396:x1870853239245440:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184976.406206:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10396:x1870853239245440:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 624us (3672us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784184976.406215:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784184976.508316:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184976.508408:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239245696 00000100:00100000:0.0:1784184976.508421:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239245696 00000100:00100000:0.0:1784184976.508496:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1784184976.508506:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10403:x1870853239245696:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784184976.508536:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184976.508815:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b041a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ed4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.508940:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.508956:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 22 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.508964:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.509038:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 22 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184976.509051:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 22 pid: 5794 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184976.509063:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265491072:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184976.509181:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f983c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1784184976.514195:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265491072:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184976.514239:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184976.517784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184976.517933:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239245824 00000100:00100000:1.0:1784184976.517947:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239245824 00010000:00010000:1.0:1784184976.518077:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 23 pid: 5794 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184976.518148:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:1.0:1784184976.518160:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+23:2355:x1870853239245824:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184976.518183:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184976.518192:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 23 pid: 5794 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.518207:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 23 pid: 5794 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.518237:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ec6 expref: 23 pid: 5794 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.518261:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:1.0:1784184976.518267:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.518278:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.518287:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.518444:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184976.518513:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2355:x1870853239245824:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 355us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184976.518521:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00010000:00010000:2.0:1784184976.520265:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.520283:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184976.520312:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1784184976.520587:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b041a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.520813:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.520824:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184976.520828:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784184976.520832:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631cc00, rc 0) 00000100:00100000:2.0:1784184976.520985:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+22:10403:x1870853239245696:12345-192.168.201.29@tcp:101:bash.0 Request processed in 12479us (12684us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1784184976.520995:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:2.0:1784184976.524273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184976.524460:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239246080 00000100:00100000:1.0:1784184976.524490:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239246080 00000100:00100000:1.0:1784184976.524595:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1784184976.524617:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+22:10403:x1870853239246080:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:1.0:1784184976.525064:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.525088:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184976.525102:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784184976.525168:0:7503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1784184976.525201:0:7503:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093e7a3a7 reply state 0000000085ca07f3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184976.525212:0:7503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784184976.525424:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+25:10403:x1870853239246080:12345-192.168.201.29@tcp:36:bash.0 Request processed in 809us (1163us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1784184976.525433:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000020:00080000:1.0:1784184976.525439:0:7503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784184976.528020:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.528043:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.528074:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.528082:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184976.528087:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.528096:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.528116:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:3.0:1784184976.528119:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184976.528125:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.528132:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b042f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184976.531791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184976.532091:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239246208 00000100:00100000:3.0:1784184976.532104:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239246208 00000100:00100000:3.0:1784184976.532180:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1784184976.532193:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+24:10403:x1870853239246208:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784184976.532225:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184976.532253:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186edb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.532403:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.532422:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.532451:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.532496:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.532512:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 25 pid: 5792 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184976.532529:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7e98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265491200:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184976.532637:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb92496c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784184976.536993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.537141:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239246336 00000100:00100000:2.0:1784184976.537153:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239246336 00010000:00010000:2.0:1784184976.537208:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 26 pid: 5792 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184976.537263:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:2.0:1784184976.537274:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:2355:x1870853239246336:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184976.537294:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184976.537302:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 26 pid: 5792 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.537317:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 26 pid: 5792 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.537398:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184976.537422:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.537434:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.537444:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.537468:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184976.537535:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:2355:x1870853239246336:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 262us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184976.537545:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00010000:00010000:3.0:1784184976.537661:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0421 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ed4 expref: 25 pid: 5792 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184976.537682:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7e98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265491200:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184976.537706:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.537715:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.537721:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184976.537779:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784184976.537783:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784184976.537814:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.537858:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186edb expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.537875:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186edb expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.537884:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:3.0:1784184976.537887:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784184976.537890:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e600, rc 0) 00000100:00100000:3.0:1784184976.537919:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+24:10403:x1870853239246208:12345-192.168.201.29@tcp:101:bash.0 Request processed in 5730us (6143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184976.537926:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:1.0:1784184976.541763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184976.541880:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239246592 00000100:00100000:0.0:1784184976.541892:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239246592 00000100:00100000:0.0:1784184976.541968:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1784184976.541982:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa0560050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+24:10403:x1870853239246592:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1784184976.542298:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa0560050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+25:10403:x1870853239246592:12345-192.168.201.29@tcp:35:bash.0 Request processed in 319us (549us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1784184976.542307:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1784184976.588060:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184976.588092:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7e98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265491328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184976.588184:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184976.588306:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265491328 00000100:00100000:0.0:1784184976.588316:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265491328 00000100:00100000:0.0:1784184976.588436:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784184976.588446:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265491328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784184976.588492:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784184976.588548:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265491328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184976.588555:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784184976.588819:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7e98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265491328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184976.649325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.649805:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239246848 00000100:00100000:2.0:1784184976.649819:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239246848 00000100:00100000:2.0:1784184976.649898:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:2.0:1784184976.649909:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+25:10413:x1870853239246848:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184976.649942:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184976.649985:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ee2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184976.650395:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1784184976.650600:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0444 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ee2 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.650617:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:2.0:1784184976.650621:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784184976.650627:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ee2 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.650658:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d200, rc 0) 00000100:00100000:2.0:1784184976.650747:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+26:10413:x1870853239246848:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 839us (1438us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1784184976.650756:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1784184976.656311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.657281:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239246976 00000100:00100000:2.0:1784184976.657295:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239246976 00000100:00100000:2.0:1784184976.657536:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:2.0:1784184976.657550:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:10413:x1870853239246976:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1784184976.657679:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.657699:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.657714:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.657731:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.657860:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.657869:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658530:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658555:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658564:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784184976.658620:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658830:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658837:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658843:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658849:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184976.658854:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658861:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658875:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184976.658879:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184976.658884:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658890:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658914:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658920:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658925:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658930:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158da00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184976.658933:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658938:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.658946:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296eb00) 00010000:00010000:2.0:1784184976.658948:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184976.659017:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659025:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0459 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659047:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659054:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659060:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659073:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184976.659077:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659083:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659092:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184976.659094:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184976.659097:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.659103:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184976.659570:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:10413:x1870853239246976:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 2017us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184976.659581:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1784184976.671629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184976.675974:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239247232 00000100:00100000:0.0:1784184976.676016:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239247232 00000100:00100000:0.0:1784184976.676098:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1784184976.676110:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+26:10413:x1870853239247232:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784184976.677123:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+27:10413:x1870853239247232:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 1008us (5502us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1784184976.677134:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784184976.717295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.717511:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239247488 00000100:00100000:2.0:1784184976.717524:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239247488 00000100:00100000:2.0:1784184976.717596:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:2.0:1784184976.717610:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+27:10416:x1870853239247488:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184976.717653:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184976.717682:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ee9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.717797:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.717827:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.717842:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.717860:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.717868:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.717876:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718295:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b047c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718303:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b047c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718309:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b047c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184976.718318:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784184976.718486:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718495:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718502:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718516:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158da00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184976.718521:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718530:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718551:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184976.718554:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184976.718560:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718566:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b046e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718581:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718586:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718592:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718598:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184976.718601:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718607:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718627:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296eb00) 00010000:00010000:2.0:1784184976.718630:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184976.718633:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718639:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718691:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ee9 expref: 30 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718708:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b047c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ee9 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.718715:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184976.718718:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184976.718720:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d200, rc 0) 00000100:00100000:2.0:1784184976.718809:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10416:x1870853239247488:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1202us (1526us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1784184976.718818:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1784184976.721890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184976.729089:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239247616 00000100:00100000:3.0:1784184976.729108:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239247616 00000100:00100000:3.0:1784184976.730130:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:3.0:1784184976.730150:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10416:x1870853239247616:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1784184976.730248:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730272:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730289:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730326:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730382:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730391:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730398:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184976.730403:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730413:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730428:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:3.0:1784184976.730431:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784184976.730437:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.730444:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b048a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184976.730869:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10416:x1870853239247616:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 724us (8988us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184976.730880:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1784184976.731108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.732089:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239247744 00000100:00100000:2.0:1784184976.732102:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239247744 00000100:00100000:2.0:1784184976.732172:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1784184976.732183:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+29:2355:x1870853239247744:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184976.732199:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184976.732224:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b047c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ee9 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.732265:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184976.732270:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184976.732316:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+28:2355:x1870853239247744:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 135us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184976.732323:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1784184976.733975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184976.735323:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239248000 00000100:00100000:3.0:1784184976.736450:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239248000 00000100:00100000:0.0:1784184976.736822:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1784184976.736838:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+28:10416:x1870853239248000:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184976.740817:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10416:x1870853239248000:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 3964us (6844us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1784184976.740835:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1784184976.905144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184976.905312:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239248256 00000100:00100000:3.0:1784184976.905326:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239248256 00000100:00100000:3.0:1784184976.905478:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:3.0:1784184976.905491:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10434:x1870853239248256:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1784184976.905541:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184976.905570:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ef0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.905712:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0498 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.905732:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.905749:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184976.905763:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784184976.905931:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ef0 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.905968:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0498 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ef0 expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.905979:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:3.0:1784184976.905982:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784184976.905986:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ec00, rc 0) 00000100:00100000:3.0:1784184976.906064:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10434:x1870853239248256:12345-192.168.201.29@tcp:101:cat.0 Request processed in 575us (937us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1784184976.906072:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00010000:00010000:0.0:1784184976.906852:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184976.944646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.944935:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239248384 00000100:00100000:2.0:1784184976.944949:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239248384 00000100:00100000:2.0:1784184976.945035:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:2.0:1784184976.945048:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10435:x1870853239248384:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184976.945081:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184976.945111:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b04a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ef7 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.945200:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b04ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.945217:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b04ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.945230:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b04ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184976.945554:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1784184976.945559:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184976.945664:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b04ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.945699:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b04a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ef7 expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.945727:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b04ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ef7 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.946117:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184976.946122:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784184976.946127:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d800, rc 0) 00000100:00100000:2.0:1784184976.946281:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10435:x1870853239248384:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1234us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184976.946290:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:0.0:1784184976.960112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.960858:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239248768 00000100:00100000:2.0:1784184976.960874:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239248768 00000100:00100000:1.0:1784184976.961064:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1784184976.961080:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10435:x1870853239248768:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184976.961614:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10435:x1870853239248768:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 536us (1515us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1784184976.961796:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1784184976.970653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184976.970875:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239248896 00000100:00100000:2.0:1784184976.970890:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239248896 00000100:00100000:2.0:1784184976.971079:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1784184976.971091:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10435:x1870853239248896:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:2.0:1784184976.971113:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784184976.971147:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b043d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186edb expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.971176:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ef0 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.971190:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b0341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e9c expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184976.971201:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296e700) 00010000:00010000:2.0:1784184976.971233:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184976.971312:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10435:x1870853239248896:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 222us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184976.971322:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1784184976.973846:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184976.973900:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239249024 00000100:00100000:3.0:1784184976.973913:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239249024 00000100:00100000:3.0:1784184976.974025:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:3.0:1784184976.974037:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10435:x1870853239249024:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:3.0:1784184976.974208:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.974228:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184976.974242:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784184976.975027:0:7503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784184976.975265:0:7503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1784184976.975402:0:7503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1784184976.975564:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10435:x1870853239249024:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 1522us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184976.975575:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:3.0:1784184977.011133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184977.011325:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239249152 00000100:00100000:1.0:1784184977.011413:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239249152 00000100:00100000:1.0:1784184977.011499:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:1.0:1784184977.011512:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10437:x1870853239249152:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184977.011545:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184977.011575:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b04bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186efe expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.011680:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.011698:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.011712:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.011749:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.011758:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.011764:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012162:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012173:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012180:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184977.012231:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784184977.012236:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784184977.012260:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012272:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012281:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012288:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012305:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012311:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184977.012316:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012324:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012381:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:1.0:1784184977.012385:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184977.012391:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012398:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012413:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012419:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012425:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012430:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184977.012433:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012448:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012457:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8c4f5000) 00010000:00010000:1.0:1784184977.012459:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184977.012462:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012468:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b04c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012511:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b04bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012526:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.012534:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:1.0:1784184977.012536:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784184977.012539:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8a00, rc 0) 00000100:00100000:1.0:1784184977.012639:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10437:x1870853239249152:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1129us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184977.012650:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00000040:00080000:3.0:1784184977.355658:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784184977.355675:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784184977.355735:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784184977.355781:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784184977.355958:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7e9b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265491456:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784184977.356167:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb92496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184977.367263:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7e9b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265491456:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784184977.368010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184977.368180:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239249280 00000100:00100000:2.0:1784184977.368189:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239249280 00000100:00100000:2.0:1784184977.368253:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1784184977.368266:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10448:x1870853239249280:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784184977.368394:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10448:x1870853239249280:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 130us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184977.368403:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1784184977.372131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184977.372351:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239249408 00000100:00100000:1.0:1784184977.372365:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239249408 00000100:00100000:1.0:1784184977.372437:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1784184977.372448:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10448:x1870853239249408:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784184977.372513:0:7503:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784184977.373066:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10448:x1870853239249408:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 616us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184977.373077:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:3.0:1784184977.397063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184977.406427:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239249536 00000100:00100000:1.0:1784184977.406451:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239249536 00000100:00100000:1.0:1784184977.406729:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:1.0:1784184977.406742:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10448:x1870853239249536:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784184977.406846:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.406867:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.406882:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.406901:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.406907:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.406914:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.406959:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.406969:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407009:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184977.407060:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784184977.407065:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784184977.407082:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407096:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407102:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407109:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407116:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184977.407121:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407130:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407143:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:1.0:1784184977.407146:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184977.407151:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407161:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b04d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407191:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407197:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407203:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407208:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184977.407212:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407219:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407227:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b5f8c4f5000) 00010000:00010000:1.0:1784184977.407229:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184977.407232:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407237:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b04de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407253:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407258:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407263:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407274:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184977.407278:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407284:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407292:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:1.0:1784184977.407295:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184977.407298:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.407303:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b04e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184977.409506:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10448:x1870853239249536:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 2748us (12514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184977.409527:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1784184977.420471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184977.431186:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239249792 00000100:00100000:1.0:1784184977.431210:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239249792 00000100:00100000:1.0:1784184977.431316:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:1.0:1784184977.431361:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10448:x1870853239249792:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784184977.431392:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184977.431421:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b04ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f05 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431578:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431619:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431635:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184977.431653:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784184977.431806:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431814:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431821:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431828:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184977.431833:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431841:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431857:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:1.0:1784184977.431860:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784184977.431866:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431873:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b04f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431932:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b04ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f05 expref: 33 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431952:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:1.0:1784184977.431955:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784184977.431960:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b04ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f05 expref: 33 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.431970:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9e00, rc 0) 00000100:00100000:1.0:1784184977.432083:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10448:x1870853239249792:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 756us (11765us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1784184977.432092:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:1.0:1784184977.441927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.442651:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239249920 00000100:00100000:3.0:1784184977.442686:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239249920 00000100:00100000:3.0:1784184977.442772:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:3.0:1784184977.442785:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10448:x1870853239249920:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784184977.442833:0:5792:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784184977.443264:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10448:x1870853239249920:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 478us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184977.443274:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:1.0:1784184977.446840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.447201:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239250176 00000100:00100000:3.0:1784184977.447213:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239250176 00000100:00100000:3.0:1784184977.447294:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:3.0:1784184977.447307:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10448:x1870853239250176:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784184977.447365:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184977.447369:0:7503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784184977.447406:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b04ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ef7 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.447431:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784184977.447437:0:7503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184977.447453:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0501 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f0c expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784184977.448395:0:7503:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1784184977.448721:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.448739:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.448766:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.448846:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0501 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f0c expref: 34 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.448865:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f0c expref: 33 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.448875:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83700) 00010000:00010000:3.0:1784184977.448879:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784184977.448882:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f200, rc 0) 00000100:00100000:3.0:1784184977.448966:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10448:x1870853239250176:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1661us (2142us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1784184977.448977:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:0.0:1784184977.458675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.458857:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239250432 00000100:00100000:3.0:1784184977.458870:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239250432 00000100:00100000:3.0:1784184977.458952:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:3.0:1784184977.458963:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10448:x1870853239250432:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784184977.459205:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184977.459242:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f0c expref: 33 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459266:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83700) 00010000:00010000:3.0:1784184977.459281:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184977.459310:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459393:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459405:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459422:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459429:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459434:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459794:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459802:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459810:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459816:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184977.459821:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459829:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459838:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784184977.459847:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184977.459852:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459858:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0516 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459869:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459874:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459880:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459885:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184977.459888:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459893:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459900:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcc7857e (ffff9b5f93b83a00) 00010000:00010000:3.0:1784184977.459903:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184977.459905:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.459911:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b051d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcc7857e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184977.468628:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10448:x1870853239250432:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 9646us (9947us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784184977.468668:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:2.0:1784184977.471545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.471661:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239250560 00000100:00100000:3.0:1784184977.471675:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239250560 00000100:00100000:3.0:1784184977.471750:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:3.0:1784184977.471762:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10448:x1870853239250560:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784184977.471790:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184977.471818:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f13 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.471866:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.471882:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.471895:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.472123:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 34 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.472141:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 33 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.472150:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:3.0:1784184977.472225:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784184977.472230:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e200, rc 0) 00000100:00100000:3.0:1784184977.472372:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10448:x1870853239250560:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 611us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184977.472387:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:0.0:1784184977.490971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.494363:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239250816 00000100:00100000:3.0:1784184977.494384:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239250816 00000100:00100000:3.0:1784184977.494479:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:3.0:1784184977.494491:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10448:x1870853239250816:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784184977.494603:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.494625:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.494640:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784184977.495520:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1784184977.495537:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375661204381ns, next at 376661201369ns, rc = 0 00000004:00010000:3.0:1784184977.495658:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000143e46cf reply state 00000000a1b9f9d4 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184977.495671:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784184977.498538:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+35:10448:x1870853239250816:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 4030us (7577us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1784184977.498556:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00010000:00010000:3.0:1784184977.501354:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.501376:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.501386:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.501393:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184977.501416:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.501426:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.501449:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:3.0:1784184977.501453:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784184977.501459:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.501466:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184977.504236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184977.505102:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239250944 00000100:00100000:2.0:1784184977.505116:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239250944 00000100:00100000:2.0:1784184977.505259:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1784184977.505272:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+34:10448:x1870853239250944:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784184977.505305:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184977.505361:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f1a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.505442:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.505477:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.505505:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:2.0:1784184977.505508:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784184977.505513:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d800, rc 0) 00000100:00100000:2.0:1784184977.505599:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+35:10448:x1870853239250944:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 330us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184977.505608:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1784184977.516754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184977.517232:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239251072 00000100:00100000:0.0:1784184977.517246:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239251072 00000100:00100000:0.0:1784184977.517463:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1784184977.517474:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239251072:12345-192.168.201.29@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1784184977.517518:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:0.0:1784184977.517557:0:6589:0:(genops.c:1406:class_connect()) connect: client 89741aef-63f5-4e1f-9ce7-defb19b62903, cookie 0x63160f6fbe8b0540 00002000:00100000:0.0:1784184977.517573:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 89741aef-63f5-4e1f-9ce7-defb19b62903/ffff9b5fb506c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784184977.517606:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784184977.517916:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784184977.518250:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5fa067c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784184977.518381:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2352:x1870853239251072:12345-192.168.201.29@tcp:8:lhsmtool_posix.0 Request processed in 906us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184977.518409:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1784184977.524047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184977.525863:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239251200 00000100:00100000:1.0:1784184977.525880:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239251200 00000100:00100000:1.0:1784184977.526006:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1784184977.526019:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:0:x1870853239251200:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784184977.536359:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1784184977.608801:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000001:00080000:2.0:1784184977.608841:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1784184977.611570:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:0:x1870853239251200:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 85537us (87516us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784184977.611588:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1784184977.637794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184977.637847:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239251456 00000100:00100000:2.0:1784184977.637859:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239251456 00000100:00100000:2.0:1784184977.637930:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1784184977.637955:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+35:10448:x1870853239251456:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784184977.638787:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+36:10448:x1870853239251456:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 842us (1003us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784184977.638797:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1784184977.655139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184977.656719:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239251712 00000100:00100000:2.0:1784184977.656758:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239251712 00000100:00100000:2.0:1784184977.656841:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1784184977.656854:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+36:10448:x1870853239251712:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784184977.657030:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+36:10448:x1870853239251712:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 179us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184977.657039:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:0.0:1784184977.661130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184977.661187:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239251840 00000100:00100000:0.0:1784184977.661199:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239251840 00000100:00100000:0.0:1784184977.661269:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1784184977.661282:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+36:10448:x1870853239251840:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784184977.661311:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184977.661370:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0547 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f21 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.661470:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b054e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.661487:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b054e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.661503:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b054e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184977.661554:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184977.661582:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b054e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.661612:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0547 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f21 expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.661653:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b054e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f21 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.661664:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:0.0:1784184977.661668:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784184977.661672:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631dc00, rc 0) 00000100:00100000:0.0:1784184977.661748:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+37:10448:x1870853239251840:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 469us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184977.661758:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:3.0:1784184977.667439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184977.667633:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239251968 00000100:00100000:1.0:1784184977.667647:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239251968 00000100:00100000:1.0:1784184977.668148:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:1.0:1784184977.668165:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2355:x1870853239251968:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784184977.668190:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184977.668220:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f28 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784184977.668256:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a588091, blocks: 0x1 00010000:00010000:1.0:1784184977.668285:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1784184977.668309:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784184977.669207:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.669249:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.669267:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9e00, rc 0) 00000100:00100000:1.0:1784184977.669396:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239251968:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1236us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184977.669406:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1784184977.678395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.678493:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239252224 00000100:00100000:3.0:1784184977.678507:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239252224 00000100:00100000:3.0:1784184977.678598:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:3.0:1784184977.678609:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+37:10448:x1870853239252224:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784184977.678811:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+37:10448:x1870853239252224:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 202us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184977.678820:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:2.0:1784184977.693374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184977.693469:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239252352 00000100:00100000:1.0:1784184977.693482:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239252352 00000100:00100000:1.0:1784184977.693559:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1784184977.693572:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:10448:x1870853239252352:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784184977.693605:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184977.693629:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f2f expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.693670:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.693681:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784184977.693685:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784184977.693691:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 7 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.693748:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.693764:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 7 pid: 6590 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184977.693782:0:10137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f88b93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10137:1870853265491584:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784184977.693908:0:10137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fcc480 going to sleep for 11 seconds 00000100:00100000:1.0:1784184977.697189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184977.697675:0:10137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f88b93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10137:1870853265491584:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184977.697721:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 7 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.697748:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9600, rc 0) 00000100:00100000:2.0:1784184977.697824:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:10448:x1870853239252352:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 4254us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184977.697835:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1784184977.698928:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239252480 00000100:00100000:3.0:1784184977.698956:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239252480 00010000:00010000:3.0:1784184977.699012:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 7 pid: 6590 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184977.699059:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1784184977.699088:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239252480:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184977.699105:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184977.699136:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 7 pid: 6590 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.699151:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 7 pid: 6590 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.699182:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec79f259/0x63160f6fbe8b0555 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f28 expref: 7 pid: 6590 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.699205:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784184977.699210:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784184977.699219:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 6 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.699232:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 6 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.699276:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 6 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184977.699291:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7e99f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1870853265491712:192.168.201.29@tcp:105: 00000100:00100000:3.0:1784184977.699435:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784184977.704203:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7e99f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1870853265491712:192.168.201.29@tcp:105: 00010000:00010000:3.0:1784184977.704252:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184977.704357:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239252480:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 5270us (7181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184977.704371:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:1.0:1784184977.709063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.710848:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239252608 00000100:00100000:3.0:1784184977.710871:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239252608 00002000:00100000:3.0:1784184977.710945:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b5f88b91f80 x1870853239252608/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:698/0 lens 504/0 e 0 to 0 dl 1784184988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784184977.710959:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f88b91f80 with x1870853239252608 ext(0->8) 00002000:00010000:3.0:1784184977.710965:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5f88b91f80 00000100:00100000:3.0:1784184977.711010:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1784184977.711021:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239252608:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784184977.715383:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239252608:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 4355us (6329us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784184977.715395:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00002000:00100000:3.0:1784184977.715406:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b5f88b91f80 x1870853239252608/t4294967302(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:698/0 lens 504/448 e 0 to 0 dl 1784184988 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784184977.715416:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f88b91f80 with x1870853239252608 ext(0->8) 00002000:00010000:3.0:1784184977.715422:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5f88b91f80 00000100:00100000:3.0:1784184977.720920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184977.721089:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239252736 00000100:00100000:2.0:1784184977.721108:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239252736 00000100:00100000:2.0:1784184977.721202:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:2.0:1784184977.721215:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+37:10448:x1870853239252736:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784184977.838788:0:11824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000001:00080000:0.0:1784184977.838820:0:11824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1784184977.838843:0:11824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1784184977.838864:0:11824:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1784184977.838898:0:11824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1784184977.839057:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1784184977.839068:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1784184977.840062:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10448:x1870853239252736:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 118842us (119142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184977.840077:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:1.0:1784184977.843767:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784184977.843804:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265491840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784184977.843876:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184977.844082:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265491840 00000100:00100000:3.0:1784184977.844097:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265491840 00000100:00100000:1.0:1784184977.844649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00080000:0.0:1784184977.848417:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784184977.856797:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239252864 00000100:00100000:3.0:1784184977.856822:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239252864 00000100:00100000:3.0:1784184977.856924:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784184977.856937:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265491840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784184977.857047:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:1.0:1784184977.857074:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239252864:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00002000:00010000:3.0:1784184977.857231:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784184977.857237:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784184977 00002000:00010000:3.0:1784184977.857239:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784184977.857242:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784184977 -> 1784184977 00002000:00010000:3.0:1784184977.857244:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784184977.857399:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265491840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 464us (13520us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784184977.857410:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1784184977.857452:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fbfbcd180/2, rc 0, transno 4294967303 00000100:00100000:1.0:1784184977.857462:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265491840:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1784184977.934179:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184977.938432:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239252864:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 81355us (93768us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184977.938448:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000001:00080000:2.0:1784184977.938668:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1784184977.938681:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1784184977.953475:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184977.953838:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239253120 00000100:00100000:0.0:1784184977.953849:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239253120 00000100:00100000:0.0:1784184977.953925:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1784184977.953935:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10448:x1870853239253120:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784184977.953991:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184977.954020:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b054e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f21 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.954057:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:0.0:1784184977.954063:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184977.954096:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.954109:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.954118:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784184977.954457:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d19db52 reply state 00000000f11981c2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184977.954468:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784184977.954578:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10448:x1870853239253120:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 643us (1112us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1784184977.954586:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00010000:00010000:2.0:1784184977.959425:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.959447:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.959464:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.959471:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184977.959476:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.959485:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.959508:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:2.0:1784184977.959512:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184977.959519:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184977.959526:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0563 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184977.965697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184977.965755:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239253248 00000100:00100000:2.0:1784184977.965768:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239253248 00000100:00100000:2.0:1784184977.965837:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:2.0:1784184977.965850:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239253248:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784184977.966207:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1784184977.966211:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1784184977 -> 1784184976 00002000:00010000:2.0:1784184977.966214:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784184974 00002000:00010000:2.0:1784184977.966217:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784184977 -> 1784184976 00002000:00010000:2.0:1784184977.966222:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784184977.966299:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239253248:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 451us (616us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784184977.966366:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1784184977.977045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184977.977178:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239253504 00000100:00100000:3.0:1784184977.977194:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239253504 00000100:00100000:3.0:1784184977.977277:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1784184977.977289:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10448:x1870853239253504:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784184977.977399:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.977414:0:7503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 13 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.977424:0:7503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.977458:0:7503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 13 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184977.977470:0:7503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 13 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184977.977505:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7e98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265491968:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184977.977620:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb92496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784184977.980470:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7e98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265491968:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184977.980512:0:7503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184977.991582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184977.991651:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239253632 00000100:00100000:0.0:1784184977.991665:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239253632 00010000:00010000:0.0:1784184977.991712:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 14 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184977.991757:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1784184977.991767:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:2355:x1870853239253632:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184977.991783:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184977.991791:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 14 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.991822:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 14 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.991845:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b052b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f13 expref: 14 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.991864:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:0.0:1784184977.991870:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.991880:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.991887:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.991934:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184977.991993:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2355:x1870853239253632:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 227us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184977.992001:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00010000:00010000:1.0:1784184977.992199:0:7503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992214:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992255:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992264:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992271:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992278:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184977.992283:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992290:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992306:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:1.0:1784184977.992309:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784184977.992314:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184977.992359:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b056a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184977.992446:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+12:10448:x1870853239253504:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 15157us (15415us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784184977.992468:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:1.0:1784184977.995618:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184977.995693:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239253760 00000100:00100000:0.0:1784184977.995710:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239253760 00000100:00100000:0.0:1784184977.995770:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1784184977.995781:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239253760:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784184977.995831:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.995867:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 7 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.995877:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784184977.995882:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784184977.995887:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.995927:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 7 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184977.995942:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 7 pid: 10137 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184977.995958:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6588:1870853265492096:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184977.996049:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902fe840 going to sleep for 11 seconds 00000100:00100000:0.0:1784184978.001087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.001090:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6588:1870853265492096:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184978.001134:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.001183:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239253888 00000100:00100000:2.0:1784184978.001191:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239253888 00010000:00010000:2.0:1784184978.001238:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 8 pid: 10137 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.001294:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1784184978.001306:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239253888:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184978.001378:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184978.001415:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 8 pid: 10137 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.001432:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 8 pid: 10137 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.001461:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000337a7bc/0x63160f6fbe8b055c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f2f expref: 8 pid: 10137 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.001480:0:7492:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784184978.001484:0:7492:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784184978.001492:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.001513:0:7492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.001553:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184978.001599:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.001616:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.001634:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239253888:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 327us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184978.001644:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00010000:00010000:0.0:1784184978.001657:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.001691:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.001699:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.001708:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784184978.001713:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.001722:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.001747:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.001754:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b0571 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.002040:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239253760:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 6258us (6433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184978.002050:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1784184978.006529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184978.006758:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239254144 00000100:00100000:3.0:1784184978.006767:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239254144 00000100:00100000:3.0:1784184978.006890:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1784184978.006905:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+12:10448:x1870853239254144:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784184978.007011:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.007029:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.007042:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.007313:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.007376:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.007386:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.007440:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.007458:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 13 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184978.007476:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7e98380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265492224:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184978.007906:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb92496c0 going to sleep for 11 seconds 00000100:00080000:0.0:1784184978.011679:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184978.013103:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7e98380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265492224:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184978.013142:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.017700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184978.017813:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239254272 00000100:00100000:1.0:1784184978.017828:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239254272 00010000:00010000:1.0:1784184978.017887:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 14 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184978.017944:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1784184978.017956:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:2356:x1870853239254272:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184978.017977:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184978.017987:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 14 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.018003:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 14 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.018035:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f1a expref: 14 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.018055:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:1.0:1784184978.018062:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.018073:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.018081:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.018138:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184978.018213:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2356:x1870853239254272:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 257us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184978.018223:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00010000:00010000:0.0:1784184978.018433:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.018443:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784184978.018694:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1784184978.018970:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1784184978.019036:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1784184978.019176:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1870853265492352:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784184978.019258:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184978.019312:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f91fd6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784184978.020078:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265492352 00000100:00100000:1.0:1784184978.020088:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265492352 00000100:00100000:1.0:1784184978.020164:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784184978.020177:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1870853265492352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784184978.020302:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1870853265492352:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184978.020310:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784184978.020470:0:5792:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1784184978.020478:0:5792:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fbfbcd180, transno 4294967303 00000100:00100000:0.0:1784184978.020505:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1870853265492352:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1784184978.021670:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1784184978.021940:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1870853265492480:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784184978.022014:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184978.022094:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c85b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184978.027633:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265492480 00000100:00100000:1.0:1784184978.027655:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265492480 00000100:00100000:1.0:1784184978.029072:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784184978.029092:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1870853265492480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784184978.030143:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5792:x1870853265492480:12345-0@lo:1000:mdt00_000.0 Request processed in 1054us (8126us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784184978.030157:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784184978.033986:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1870853265492480:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1784184978.034056:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034068:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034078:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034084:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184978.034089:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034097:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034117:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f93b83100) 00010000:00010000:2.0:1784184978.034120:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784184978.034126:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034146:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b057f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034202:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034210:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034217:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034223:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184978.034226:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034232:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034240:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:2.0:1784184978.034243:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784184978.034246:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034250:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b04b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034277:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034298:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034324:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034395:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.034418:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 16 pid: 5794 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.034437:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265492608:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184978.034554:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87caf900 going to sleep for 11 seconds 00000100:00100000:1.0:1784184978.047223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.047416:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265492608:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184978.047452:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.051403:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239254400 00000100:00100000:0.0:1784184978.051425:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239254400 00010000:00010000:0.0:1784184978.051694:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 17 pid: 5794 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.051795:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1784184978.051814:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+17:2356:x1870853239254400:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184978.051835:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184978.051843:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 17 pid: 5794 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.051858:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 17 pid: 5794 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.051887:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b04d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186efe expref: 17 pid: 5794 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.051903:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:0.0:1784184978.051911:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.051922:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.051931:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.051967:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184978.052043:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+16:2356:x1870853239254400:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 231us (4836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184978.052052:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00010000:00010000:2.0:1784184978.067074:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067096:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067130:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067138:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067161:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067196:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184978.067202:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067211:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067240:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:2.0:1784184978.067244:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184978.067250:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067257:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0586 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067279:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067286:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067292:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067297:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ee00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184978.067301:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067307:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067357:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:2.0:1784184978.067359:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784184978.067363:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.067368:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0578 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.068062:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+15:10448:x1870853239254144:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 61153us (61535us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1784184978.068075:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000020:00080000:2.0:1784184978.068082:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784184978.068623:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784184978.068629:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784184978.068684:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784184978.068692:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784184978.093381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.095109:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239254656 00000100:00100000:2.0:1784184978.095129:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239254656 00000100:00100000:2.0:1784184978.100713:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:2.0:1784184978.100731:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+15:10448:x1870853239254656:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784184978.102942:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784184978.103085:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1784184978.106558:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.106589:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.106605:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.106630:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.106638:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.106646:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.106700:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784184978.106877:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+17:10448:x1870853239254656:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 6143us (13502us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1784184978.106891:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000020:00080000:2.0:1784184978.106899:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784184978.107257:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784184978.107267:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.107288:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784184978.107293:0:7491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.107302:0:7491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.107329:0:7491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b5f8296eb00) 00010000:00010000:0.0:1784184978.109810:0:7491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784184978.109826:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.109839:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b058d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.109995:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184978.109998:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184978.110001:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784184978.147307:0:11864:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784184978.149913:0:11864:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784184978.150088:0:11864:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784184978.150097:0:11864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784184978.329611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184978.329724:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239254912 00000100:00100000:1.0:1784184978.329735:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239254912 00000100:00100000:1.0:1784184978.329799:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:1.0:1784184978.329810:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+17:10458:x1870853239254912:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184978.329834:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184978.329854:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f36 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.330134:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b059b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.330150:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b059b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.330163:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b059b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184978.330175:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1784184978.330383:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f36 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.330401:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b059b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f36 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.330411:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:1.0:1784184978.330414:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784184978.330417:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9c00, rc 0) 00000100:00100000:1.0:1784184978.330474:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10458:x1870853239254912:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 666us (872us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1784184978.330481:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:2.0:1784184978.338846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184978.338975:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239255040 00000100:00100000:1.0:1784184978.338986:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239255040 00000100:00100000:1.0:1784184978.339041:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:1.0:1784184978.339050:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10458:x1870853239255040:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:1.0:1784184978.339119:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339145:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339170:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339186:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339193:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339199:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339538:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339546:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339552:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784184978.339587:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339599:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339606:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339622:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339627:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184978.339631:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339638:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339649:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:1.0:1784184978.339652:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184978.339656:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339662:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b05a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339672:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339678:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339684:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339688:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184978.339691:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339705:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339713:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8c4f5d00) 00010000:00010000:1.0:1784184978.339715:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184978.339718:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339723:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339735:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339740:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339746:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339750:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184978.339753:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339758:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339764:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:1.0:1784184978.339766:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184978.339768:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.339793:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184978.339877:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10458:x1870853239255040:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 826us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184978.339884:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:1.0:1784184978.457022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184978.457244:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239255296 00000100:00100000:0.0:1784184978.457600:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239255296 00000100:00100000:0.0:1784184978.457666:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:0.0:1784184978.457676:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10461:x1870853239255296:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184978.457696:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184978.457718:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b05be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f3d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.457797:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.457813:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.457825:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.457852:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.457861:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.457867:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458605:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458616:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458625:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184978.458635:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784184978.458726:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458734:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458740:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458746:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184978.458751:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458769:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458782:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:0.0:1784184978.458785:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184978.458790:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458796:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b05c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458808:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458815:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458821:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458826:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184978.458830:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458835:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458842:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f87fe3700) 00010000:00010000:0.0:1784184978.458845:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184978.458848:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458863:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458907:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b05be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.458922:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.460135:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:0.0:1784184978.460139:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184978.460142:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784184978.460254:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10461:x1870853239255296:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 2571us (3232us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1784184978.460264:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1784184978.469113:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184978.469216:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239255424 00000100:00100000:0.0:1784184978.469226:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239255424 00000100:00100000:0.0:1784184978.469296:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:0.0:1784184978.469315:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10461:x1870853239255424:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1784184978.469412:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469429:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469442:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469484:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469492:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469499:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469505:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184978.469509:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469516:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469528:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:0.0:1784184978.469531:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784184978.469535:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.469541:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d800/0x63160f6fbe8b05e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.469622:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10461:x1870853239255424:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 316us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184978.469630:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:2.0:1784184978.478168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184978.478277:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239255680 00000100:00100000:0.0:1784184978.478288:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239255680 00000100:00100000:0.0:1784184978.478559:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1784184978.478582:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa0560850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10461:x1870853239255680:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784184978.478818:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa0560850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+22:10461:x1870853239255680:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 237us (658us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1784184978.478827:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1784184978.531419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184978.531899:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239255936 00000100:00100000:1.0:1784184978.531910:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239255936 00000100:00100000:1.0:1784184978.532029:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:1.0:1784184978.532040:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+22:9989:x1870853239255936:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1784184978.532064:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184978.532101:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f44 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.532206:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.532223:0:7503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.532232:0:7503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.532269:0:7503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.532285:0:7503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 23 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184978.532328:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9151500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265492736:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784184978.532452:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f941b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1784184978.536430:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9151500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265492736:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784184978.536459:0:7503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184978.544394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184978.544552:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239256064 00000100:00100000:1.0:1784184978.544569:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239256064 00010000:00010000:1.0:1784184978.544624:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 24 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184978.544736:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1784184978.544747:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+24:2356:x1870853239256064:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184978.544773:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184978.544781:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 24 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.544796:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 24 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.544819:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b05d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f3d expref: 24 pid: 5793 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.544838:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:1.0:1784184978.544843:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.544866:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.544873:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.544908:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184978.544980:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+23:2356:x1870853239256064:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 234us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184978.544988:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00010000:00010000:3.0:1784184978.545434:0:7503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.545449:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184978.545526:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784184978.545758:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b05e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 24 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.545782:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 23 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184978.545792:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:3.0:1784184978.545795:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784184978.545799:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8800, rc 0) 00000100:00100000:3.0:1784184978.546175:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+23:9989:x1870853239255936:12345-192.168.201.29@tcp:101:bash.0 Request processed in 14135us (14763us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1784184978.546185:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:3.0:1784184978.557436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184978.557548:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239256320 00000100:00100000:0.0:1784184978.557567:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239256320 00000100:00100000:0.0:1784184978.557738:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:0.0:1784184978.557751:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+23:9989:x1870853239256320:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1784184978.558170:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.558193:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.558206:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784184978.558266:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1784184978.558295:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004942044e reply state 00000000045accb3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.558323:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784184978.558415:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1784184978.558562:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+27:9989:x1870853239256320:12345-192.168.201.29@tcp:36:bash.0 Request processed in 812us (1136us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1784184978.558571:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 89 00000020:00080000:0.0:1784184978.558577:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1784184978.562761:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.562788:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.562797:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.562803:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184978.562808:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.562815:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.562830:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:1.0:1784184978.562833:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184978.562838:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.562863:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b05fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184978.563299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184978.563424:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239256448 00000100:00100000:1.0:1784184978.563434:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239256448 00000100:00100000:1.0:1784184978.563483:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:1.0:1784184978.563492:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+26:9989:x1870853239256448:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1784184978.563517:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184978.563536:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f4b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.563605:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f4b expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.563619:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f4b expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.563639:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:1.0:1784184978.563642:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784184978.563645:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9200, rc 0) 00000100:00100000:1.0:1784184978.563704:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+27:9989:x1870853239256448:12345-192.168.201.29@tcp:101:bash.0 Request processed in 211us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184978.563710:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:3.0:1784184978.570101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.570227:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239256576 00000100:00100000:2.0:1784184978.570237:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239256576 00000100:00100000:2.0:1784184978.570314:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1784184978.570326:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:9989:x1870853239256576:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784184978.570404:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184978.570429:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f52 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784184978.570458:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a588090, atime: 0x6a58808e, ctime: 0x6a588090, blocks: 0xb 00010000:00010000:2.0:1784184978.570481:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1784184978.570485:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184978.570494:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.570511:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.570523:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c400, rc 0) 00000100:00100000:2.0:1784184978.570587:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:9989:x1870853239256576:12345-192.168.201.29@tcp:101:bash.0 Request processed in 263us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184978.570594:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1784184978.577710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184978.577813:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239256704 00000100:00100000:0.0:1784184978.577823:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239256704 00002000:00010000:0.0:1784184978.577878:0:6594:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1784184978.577883:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb9151500 with x1870853239256704 ext(0->18446744073709551615) 00002000:00010000:0.0:1784184978.577895:0:6594:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fb9151500. 00000100:00100000:0.0:1784184978.577931:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1784184978.577941:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2354:x1870853239256704:12345-192.168.201.29@tcp:10:bash.0 00002000:00010000:0.0:1784184978.578224:0:6594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784184978.578228:0:6594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1784184976 -> 1784184978 00002000:00010000:0.0:1784184978.578230:0:6594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1784184974 -> 1784184974 00002000:00010000:0.0:1784184978.578232:0:6594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784184976 -> 1784184978 00002000:00010000:0.0:1784184978.578234:0:6594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1784184978.578300:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2354:x1870853239256704:12345-192.168.201.29@tcp:10:bash.0 Request processed in 359us (597us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784184978.578319:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00002000:00010000:0.0:1784184978.578324:0:6594:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1784184978.578327:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb9151500 with x1870853239256704 ext(0->18446744073709551615) 00002000:00010000:0.0:1784184978.578374:0:6594:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fb9151500. 00000100:00100000:1.0:1784184978.709859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.711378:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239256832 00000100:00100000:2.0:1784184978.711393:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239256832 00000100:00100000:2.0:1784184978.711465:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:2.0:1784184978.711475:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+27:10475:x1870853239256832:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1784184978.711555:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.712759:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.712864:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.712890:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.712898:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.712903:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713260:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713270:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713277:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784184978.713353:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713366:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713372:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713378:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713395:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184978.713400:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713407:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713420:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184978.713423:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184978.713428:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713433:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713443:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713446:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713450:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713453:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184978.713454:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713458:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713469:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296e800) 00010000:00010000:2.0:1784184978.713471:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184978.713473:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713476:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713486:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713489:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713492:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713495:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184978.713497:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713500:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713504:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:2.0:1784184978.713505:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184978.713507:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.713509:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.714113:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+27:10475:x1870853239256832:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 2633us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184978.714123:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:3.0:1784184978.753581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184978.753913:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239257088 00000100:00100000:1.0:1784184978.753923:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239257088 00000100:00100000:1.0:1784184978.754053:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:1.0:1784184978.754063:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+27:10478:x1870853239257088:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184978.754084:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184978.754104:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f59 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754177:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754190:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754202:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754215:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754221:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754226:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754563:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b063c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754572:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b063c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754579:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b063c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184978.754601:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784184978.754693:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754701:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754708:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754714:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184978.754718:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754724:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754740:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:1.0:1784184978.754743:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184978.754747:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754753:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b062e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754763:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754770:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754787:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754792:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184978.754795:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754800:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754808:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8c4f5700) 00010000:00010000:1.0:1784184978.754810:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184978.754812:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754818:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754857:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f59 expref: 30 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754871:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b063c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f59 expref: 29 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184978.754878:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:1.0:1784184978.754880:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784184978.754883:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8e00, rc 0) 00000100:00100000:1.0:1784184978.754949:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10478:x1870853239257088:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 888us (1378us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1784184978.754966:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:1.0:1784184978.762970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184978.763206:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239257216 00000100:00100000:0.0:1784184978.763217:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239257216 00000100:00100000:0.0:1784184978.763470:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:0.0:1784184978.763485:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10478:x1870853239257216:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1784184978.763636:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.763655:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 29 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.763664:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.763712:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 29 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.763724:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 29 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.763740:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265492864:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184978.764036:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c85b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784184978.768410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.768548:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239257472 00000100:00100000:2.0:1784184978.768555:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239257472 00000100:00100000:2.0:1784184978.768605:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:2.0:1784184978.768612:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+30:5571:x1870853239257472:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784184978.768928:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+31:5571:x1870853239257472:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 314us (528us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1784184978.768936:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1784184978.769047:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265492864:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184978.769076:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184978.771916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.773394:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239257600 00000100:00100000:2.0:1784184978.773407:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239257600 00010000:00010000:2.0:1784184978.773453:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 31 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.773502:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1784184978.773511:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+31:2355:x1870853239257600:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184978.773525:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184978.773532:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 31 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.773544:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 31 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.773576:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b05ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f44 expref: 31 pid: 7503 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.773608:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:2.0:1784184978.773613:0:7492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.773623:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.773756:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184978.773930:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184978.773957:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.773965:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.773993:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+30:2355:x1870853239257600:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 483us (2086us total) trans 0 rc 0/0 00010000:00010000:0.0:1784184978.773996:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184978.774001:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00010000:00010000:0.0:1784184978.774002:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.774008:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.774013:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184978.774017:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.774032:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.774042:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:0.0:1784184978.774044:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784184978.774048:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.774054:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b064a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184978.774093:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10478:x1870853239257216:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 10613us (11134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184978.774100:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:1.0:1784184978.777686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.777771:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239257856 00000100:00100000:2.0:1784184978.777781:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239257856 00000100:00100000:2.0:1784184978.777836:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1784184978.777845:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:10478:x1870853239257856:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1784184978.778077:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10478:x1870853239257856:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 233us (400us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1784184978.778082:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00010000:00010000:0.0:1784184978.958806:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184978.970824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184978.971022:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239258112 00000100:00100000:0.0:1784184978.971034:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239258112 00000100:00100000:0.0:1784184978.971101:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:0.0:1784184978.971112:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+30:10489:x1870853239258112:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1784184978.971136:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184978.971158:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f60 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971234:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971262:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971297:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971325:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971363:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971371:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971739:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971750:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971758:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184978.971768:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1784184978.971858:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971865:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971873:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971880:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184978.971890:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971898:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971910:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:0.0:1784184978.971913:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184978.971917:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971923:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971936:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971942:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971948:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971953:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184978.971956:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971961:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971968:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f87fe3700) 00010000:00010000:0.0:1784184978.971970:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184978.971980:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.971986:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b065f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.972029:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f60 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.972042:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f60 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184978.972049:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:0.0:1784184978.972052:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184978.972055:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784184978.972125:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10489:x1870853239258112:12345-192.168.201.29@tcp:101:cat.0 Request processed in 1014us (1309us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1784184978.972132:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:0.0:1784184978.977885:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184978.978000:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239258368 00000100:00100000:2.0:1784184978.978011:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239258368 00000100:00100000:2.0:1784184978.978074:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1784184978.978084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10489:x1870853239258368:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:2.0:1784184978.978446:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10489:x1870853239258368:12345-192.168.201.29@tcp:35:cat.0 Request processed in 362us (569us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1784184978.978468:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:1.0:1784184979.061432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.061748:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239258624 00000100:00100000:2.0:1784184979.061758:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239258624 00000100:00100000:2.0:1784184979.061811:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:2.0:1784184979.061820:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10490:x1870853239258624:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:2.0:1784184979.061879:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784184979.061905:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f60 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.061938:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b063c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f59 expref: 32 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.061951:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f4b expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.061962:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f87fe3200) 00010000:00010000:2.0:1784184979.061973:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784184979.061994:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062008:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062017:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062030:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062055:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062062:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062438:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062448:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.062455:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784184979.064871:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1784184979.064886:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377230553190ns, next at 378230549655ns, rc = 0 00010000:00010000:2.0:1784184979.064983:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.064997:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.065007:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.065015:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.065021:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.065038:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067120:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784184979.067161:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067171:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067178:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067184:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.067188:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067195:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067211:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:2.0:1784184979.067214:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784184979.067219:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067224:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0682 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067260:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067266:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067288:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067294:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.067306:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067313:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067322:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184979.067324:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184979.067327:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.067349:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b0674 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784184979.067360:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043bf4028 reply state 000000002169c3b0 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.067368:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784184979.067476:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:10490:x1870853239258624:12345-192.168.201.29@tcp:36:rm.0 Request processed in 5652us (6049us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1784184979.067484:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00010000:00010000:3.0:1784184979.078584:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784184979.078599:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.078610:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784184979.078615:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.078624:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.078642:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:3.0:1784184979.078645:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784184979.078649:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.078655:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.078676:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184979.078692:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184979.078694:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184979.082764:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.082782:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.082808:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.082814:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.082819:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.082828:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.082843:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296e800) 00010000:00010000:2.0:1784184979.082846:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184979.082851:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.082857:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b067b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184979.148044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184979.148225:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239258880 00000100:00100000:3.0:1784184979.148240:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239258880 00000100:00100000:3.0:1784184979.148386:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1784184979.148400:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+31:10496:x1870853239258880:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784184979.148433:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184979.148463:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0690 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f67 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.149694:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.149717:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.149730:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.149744:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.149749:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.149769:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784184979.153743:0:7503:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784184979.154164:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154197:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154213:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154265:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154273:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154280:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154285:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.154447:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154458:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154474:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184979.154477:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184979.154501:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154627:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0697 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784184979.154647:0:7503:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d48dd15 reply state 00000000cce0b0e9 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.154657:0:7503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784184979.154704:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 34 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154723:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 33 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.154731:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:2.0:1784184979.154734:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184979.154736:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d400, rc 0) 00000100:00100000:2.0:1784184979.154916:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+34:10496:x1870853239258880:12345-192.168.201.29@tcp:101:bash.0 Request processed in 6518us (6880us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1784184979.154926:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00010000:00010000:3.0:1784184979.159810:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.159835:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.159844:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.159850:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184979.159857:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.159865:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.159888:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8296e800) 00010000:00010000:3.0:1784184979.159891:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184979.159896:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.159932:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b069e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184979.167107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.167175:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239259008 00000100:00100000:2.0:1784184979.167189:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239259008 00000100:00100000:2.0:1784184979.167288:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1784184979.167319:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239259008:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784184979.167366:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184979.167397:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f6e expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784184979.167462:0:10137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784184979.167490:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1784184979.167495:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184979.167684:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 8 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.167713:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 8 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.167730:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158dc00, rc 0) 00000100:00100000:2.0:1784184979.167806:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239259008:12345-192.168.201.29@tcp:101:bash.0 Request processed in 489us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184979.167814:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00080000:0.0:1784184979.169471:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184979.173934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.174047:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239259136 00000100:00100000:0.0:1784184979.174058:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239259136 00000100:00100000:0.0:1784184979.174120:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:0.0:1784184979.174132:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+8:10496:x1870853239259136:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784184979.174157:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184979.174181:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f75 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.174218:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 9 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.174243:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184979.174247:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184979.174252:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.174290:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 9 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.174317:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 9 pid: 10137 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.174377:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1870853265492992:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184979.174474:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165c900 going to sleep for 11 seconds 00000100:00100000:3.0:1784184979.179028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.179101:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239259264 00000100:00100000:2.0:1784184979.179113:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239259264 00010000:00010000:2.0:1784184979.179167:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 10 pid: 10137 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.179221:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1784184979.179233:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2355:x1870853239259264:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184979.179255:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184979.179286:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 10 pid: 10137 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.179391:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 10 pid: 10137 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.179426:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184979.179432:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184979.179441:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.179451:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.179500:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.179688:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1870853265493120:192.168.201.29@tcp:105: 00000100:00100000:2.0:1784184979.179795:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fcc3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784184979.181552:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b06b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f6e expref: 10 pid: 10137 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.181590:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1870853265492992:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184979.181899:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.181915:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631dc00, rc 0) 00000100:00100000:0.0:1784184979.181984:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:10496:x1870853239259136:12345-192.168.201.29@tcp:101:bash.0 Request processed in 7855us (8071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184979.182018:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:2.0:1784184979.184403:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1870853265493120:192.168.201.29@tcp:105: 00010000:00010000:2.0:1784184979.184444:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184979.184516:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239259264:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 5284us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184979.184530:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1784184979.190757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.190905:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239259520 00000100:00100000:2.0:1784184979.190918:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239259520 00000100:00100000:2.0:1784184979.190998:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1784184979.191028:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+33:10496:x1870853239259520:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1784184979.191606:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+34:10496:x1870853239259520:12345-192.168.201.29@tcp:35:bash.0 Request processed in 577us (1021us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1784184979.191616:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1784184979.364269:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.365035:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239259648 00000100:00100000:0.0:1784184979.365047:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239259648 00000100:00100000:0.0:1784184979.365117:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:0.0:1784184979.365127:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+34:10512:x1870853239259648:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184979.365151:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184979.365176:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b06c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f7c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.365269:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b06c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.365283:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b06c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.365306:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b06c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184979.365404:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1784184979.365408:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184979.365433:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b06c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.365461:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b06c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f7c expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.365481:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b06c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f7c expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.365502:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:0.0:1784184979.365861:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784184979.365866:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d600, rc 0) 00000100:00100000:0.0:1784184979.366140:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+35:10512:x1870853239259648:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1012us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184979.366148:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:3.0:1784184979.383476:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.383598:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239259904 00000100:00100000:0.0:1784184979.383608:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239259904 00000100:00100000:0.0:1784184979.383674:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:0.0:1784184979.383686:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+35:10512:x1870853239259904:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184979.383706:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184979.383730:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b06cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f83 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.383849:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b06d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.383863:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b06d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.383875:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b06d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184979.383888:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784184979.384277:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b06cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f83 expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.384329:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b06d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f83 expref: 37 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.384403:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:0.0:1784184979.384407:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184979.384410:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784184979.384477:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+37:10512:x1870853239259904:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 794us (1011us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1784184979.384486:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:1.0:1784184979.388980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184979.389031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.389138:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239260032 00000100:00100000:0.0:1784184979.389147:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239260032 00000100:00100000:0.0:1784184979.389215:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1784184979.389225:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+37:2356:x1870853239260032:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184979.389241:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184979.389267:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b06d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f83 expref: 37 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.389285:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:0.0:1784184979.389290:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184979.389379:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+36:2356:x1870853239260032:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 155us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184979.389387:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1784184979.389750:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239260288 00000100:00100000:2.0:1784184979.389764:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239260288 00000100:00100000:2.0:1784184979.389804:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:2.0:1784184979.389812:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+36:10512:x1870853239260288:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184979.389833:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184979.389849:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b06e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f8a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.389948:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b06eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.389962:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b06eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.389972:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b06eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184979.389982:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784184979.390106:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b06e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f8a expref: 39 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.390120:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b06eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f8a expref: 38 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.390139:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:2.0:1784184979.390142:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784184979.390144:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158cc00, rc 0) 00000100:00100000:2.0:1784184979.390175:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+38:10512:x1870853239260288:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 364us (1143us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1784184979.390181:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:1.0:1784184979.401717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.404692:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239260416 00000100:00100000:2.0:1784184979.404714:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239260416 00000100:00100000:2.0:1784184979.404869:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:2.0:1784184979.404884:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239260416:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:2.0:1784184979.404961:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.404989:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.405000:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184979.405015:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784184979.405022:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.405075:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.405092:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 8 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.405130:0:10137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10137:1870853265493248:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184979.405267:0:10137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fcc540 going to sleep for 11 seconds 00000100:00100000:1.0:1784184979.414004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.414421:0:10137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10137:1870853265493248:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184979.414462:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.414571:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239260544 00000100:00100000:3.0:1784184979.414581:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239260544 00002000:00100000:3.0:1784184979.414829:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b5fb9150e00 x1870853239260544/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:700/0 lens 504/0 e 0 to 0 dl 1784184990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784184979.414841:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb9150e00 with x1870853239260544 ext(0->8) 00010000:00010000:3.0:1784184979.414850:0:6596:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 9 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.414867:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 9 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784184979.414876:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5fb9150e00 00000100:00100000:3.0:1784184979.414913:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1784184979.414924:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239260544:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:2.0:1784184979.418899:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+11:2355:x1870853239260544:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 3956us (4891us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784184979.418938:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00002000:00100000:2.0:1784184979.418958:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b5fb9150e00 x1870853239260544/t4294967302(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:700/0 lens 504/448 e 0 to 0 dl 1784184990 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784184979.418971:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb9150e00 with x1870853239260544 ext(0->8) 00010000:00010000:2.0:1784184979.418985:0:6596:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 11 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.419022:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 11 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784184979.419032:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5fb9150e00 00000100:00100000:0.0:1784184979.427973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184979.430017:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239260672 00000100:00100000:1.0:1784184979.430031:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239260672 00010000:00010000:1.0:1784184979.430080:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 11 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184979.430137:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:1.0:1784184979.430146:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+11:2354:x1870853239260672:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184979.430161:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784184979.430180:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784184979.430184:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784184978 00002000:00010000:1.0:1784184979.430186:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784184979 00002000:00010000:1.0:1784184979.430188:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784184978 00010000:00010000:1.0:1784184979.430194:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 11 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.430223:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 11 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.430248:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000367e758c/0x63160f6fbe8b06ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f75 expref: 11 pid: 6590 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.430266:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784184979.430270:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784184979.430276:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.430287:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.430389:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184979.430450:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2354:x1870853239260672:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 305us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184979.430459:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00010000:00010000:3.0:1784184979.430944:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.430955:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.430996:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.431004:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.431011:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.431018:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784184979.431023:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.431032:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.431044:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.431052:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071bb8d3e/0x63160f6fbe8b06f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.431115:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239260416:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 26235us (29411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184979.431123:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1784184979.441192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184979.441521:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239260928 00000100:00100000:3.0:1784184979.441532:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239260928 00000100:00100000:3.0:1784184979.441596:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:3.0:1784184979.441607:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+38:10512:x1870853239260928:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:3.0:1784184979.441673:0:5795:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b06eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f8a expref: 38 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784184979.441963:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1784184979.442016:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1784184979.442393:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1784184979.442449:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.442466:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 42 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.442476:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.442510:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 42 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.442526:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 42 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.442542:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1870853265493376:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184979.442637:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249780 going to sleep for 11 seconds 00000100:00100000:0.0:1784184979.449976:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184979.450073:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239261056 00000100:00100000:1.0:1784184979.450081:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239261056 00010000:00010000:1.0:1784184979.450116:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 43 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184979.450157:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1784184979.450167:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+43:2356:x1870853239261056:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184979.450194:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184979.450202:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 43 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.450216:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 43 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.450239:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:1.0:1784184979.450244:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.450253:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.450260:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.450277:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184979.450366:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+43:2356:x1870853239261056:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 200us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184979.450374:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00010000:00010000:3.0:1784184979.450948:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b06a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f67 expref: 42 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.450974:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1870853265493376:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184979.450992:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.450998:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.451002:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784184979.451109:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1784184979.451319:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1784184979.451456:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265493504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784184979.451986:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184979.452068:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184979.458456:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265493504 00000100:00100000:2.0:1784184979.458470:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265493504 00000100:00100000:2.0:1784184979.458549:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784184979.458560:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5795:x1870853265493504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784184979.458690:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5795:x1870853265493504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 132us (6704us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184979.458695:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784184979.458992:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784184979.459101:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265493504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784184979.459561:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1784184979.459625:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265493632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784184979.459659:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184979.459684:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249780 going to sleep for 11 seconds 00000100:00100000:2.0:1784184979.460007:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265493632 00000100:00100000:2.0:1784184979.460012:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265493632 00000100:00100000:2.0:1784184979.460045:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784184979.460050:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5795:x1870853265493632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784184979.460212:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5795:x1870853265493632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 161us (551us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784184979.460220:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784184979.460375:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265493632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784184979.460420:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1784184979.460450:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.460457:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.460472:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.460477:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184979.460480:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.460485:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.460498:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:3.0:1784184979.460500:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784184979.460561:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.460567:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0700 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784184979.460699:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784184979.461071:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1784184979.461080:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377626747610ns, next at 378626746518ns, rc = 0 00000001:00080000:3.0:1784184979.461086:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1784184979.461108:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8296ee00) 00010000:00010000:3.0:1784184979.461110:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784184979.461115:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b06eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f8a expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.461212:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+45:10512:x1870853239260928:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 19608us (20030us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1784184979.461231:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000020:00080000:3.0:1784184979.461236:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784184979.464469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184979.464549:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239261184 00000100:00100000:1.0:1784184979.464558:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239261184 00000100:00100000:1.0:1784184979.464613:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:1.0:1784184979.464623:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+45:10512:x1870853239261184:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184979.464646:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184979.464671:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f91 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.464778:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f91 expref: 46 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.464792:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f91 expref: 46 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.464810:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:1.0:1784184979.464813:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784184979.464816:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9400, rc 0) 00000100:00100000:1.0:1784184979.464878:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+46:10512:x1870853239261184:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 256us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184979.464884:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:1.0:1784184979.468628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.474455:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239261440 00000100:00100000:2.0:1784184979.474469:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239261440 00000100:00100000:2.0:1784184979.474539:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1784184979.474553:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+46:10512:x1870853239261440:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1784184979.475139:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+47:10512:x1870853239261440:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 589us (6518us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1784184979.475149:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:3.0:1784184979.646005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.646374:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239261568 00000100:00100000:2.0:1784184979.646388:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239261568 00000100:00100000:2.0:1784184979.646466:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:2.0:1784184979.646480:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+47:10522:x1870853239261568:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1784184979.646592:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646615:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646647:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646667:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646676:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646683:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646817:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646826:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646833:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784184979.646896:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646911:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646919:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646926:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646942:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.646947:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646956:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646971:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184979.646974:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184979.646980:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.646987:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b070e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647002:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647009:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647015:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647020:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158de00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.647022:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647028:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647045:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f988b7200) 00010000:00010000:2.0:1784184979.647047:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184979.647050:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647055:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647069:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647074:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647079:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647084:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.647088:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647094:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647100:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184979.647102:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184979.647105:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.647110:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b071c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.647381:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+47:10522:x1870853239261568:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 855us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184979.647391:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:0.0:1784184979.705119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184979.705667:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239261824 00000100:00100000:1.0:1784184979.705681:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239261824 00000100:00100000:1.0:1784184979.705984:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:1.0:1784184979.706007:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+47:10525:x1870853239261824:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184979.706033:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184979.706059:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0723 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f98 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.706151:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.706170:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.706210:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.706230:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.706238:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.706245:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707226:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707242:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707252:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184979.707264:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1784184979.707534:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707543:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707551:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707557:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184979.707573:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707582:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707596:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:1.0:1784184979.707599:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184979.707603:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707610:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b072a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707634:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707641:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707648:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707653:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8e00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184979.707656:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707662:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707669:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8c4f5d00) 00010000:00010000:1.0:1784184979.707671:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184979.707679:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707686:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8e00/0x63160f6fbe8b0731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707739:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0723 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 50 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.707753:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 49 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.708108:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:1.0:1784184979.708111:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784184979.708114:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8000, rc 0) 00000100:00100000:1.0:1784184979.708214:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+49:10525:x1870853239261824:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 2217us (3109us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1784184979.708224:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:2.0:1784184979.714120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.714354:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239261952 00000100:00100000:0.0:1784184979.714368:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239261952 00000100:00100000:0.0:1784184979.714582:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:0.0:1784184979.714595:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+49:10525:x1870853239261952:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1784184979.714687:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.714707:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.714722:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.715121:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.715132:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.715139:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.715147:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184979.715152:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.715161:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.715197:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184979.715200:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784184979.715206:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.715213:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.715378:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+49:10525:x1870853239261952:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 735us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184979.715388:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:3.0:1784184979.720863:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.720982:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239262208 00000100:00100000:0.0:1784184979.720994:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239262208 00000100:00100000:0.0:1784184979.721069:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:0.0:1784184979.721082:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+49:10525:x1870853239262208:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784184979.721465:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+50:10525:x1870853239262208:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 384us (615us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1784184979.721474:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1784184979.813556:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.813898:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239262464 00000100:00100000:0.0:1784184979.813910:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239262464 00000100:00100000:0.0:1784184979.814001:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:0.0:1784184979.814014:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+50:10535:x1870853239262464:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784184979.814049:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184979.814053:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784184979.814087:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b06c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f7c expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.814142:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:0.0:1784184979.814149:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184979.814170:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b074d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186f9f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.814308:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.814324:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 50 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.814398:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.814455:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 50 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.814470:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 50 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.814489:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265493760:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184979.814910:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c85b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784184979.820813:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265493760:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784184979.820819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:0.0:1784184979.820857:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.820983:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239262592 00000100:00100000:0.0:1784184979.821010:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239262592 00010000:00010000:0.0:1784184979.821062:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 51 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.821111:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:0.0:1784184979.821123:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+51:2356:x1870853239262592:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184979.821142:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184979.821152:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 51 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.821167:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 51 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.821197:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8000/0x63160f6fbe8b0738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f98 expref: 51 pid: 7503 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.821218:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184979.821225:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.821236:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.821245:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.821279:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784184979.821380:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.821388:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184979.821415:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1784184979.821416:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+50:2356:x1870853239262592:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 295us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184979.821443:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00010000:00010000:1.0:1784184979.821621:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b074d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.821636:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.821646:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:1.0:1784184979.821649:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784184979.821651:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631cc00, rc 0) 00000100:00100000:1.0:1784184979.821673:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+50:10535:x1870853239262464:12345-192.168.201.29@tcp:101:bash.0 Request processed in 7665us (8136us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1784184979.821678:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:3.0:1784184979.830664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.831600:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239262848 00000100:00100000:2.0:1784184979.831614:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239262848 00000100:00100000:2.0:1784184979.831683:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 105 00000100:00100000:2.0:1784184979.831694:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+50:10535:x1870853239262848:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:2.0:1784184979.832038:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.832056:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.832066:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784184979.832110:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1784184979.832128:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013e97fdf reply state 0000000044234c61 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.832135:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784184979.832240:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+53:10535:x1870853239262848:12345-192.168.201.29@tcp:36:bash.0 Request processed in 549us (1594us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1784184979.832246:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 105 00000020:00080000:2.0:1784184979.832251:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784184979.838138:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.838174:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.838180:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.838185:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184979.838189:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.838196:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.838216:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184979.838218:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184979.838222:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.838225:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0762 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.838610:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.838688:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239262976 00000100:00100000:2.0:1784184979.838700:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239262976 00000100:00100000:2.0:1784184979.838781:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:2.0:1784184979.838797:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+52:10535:x1870853239262976:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784184979.838827:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184979.838957:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0769 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fa6 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.839069:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.839096:0:7503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.839107:0:7503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.839149:0:7503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.839165:0:7503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 53 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.839181:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265493888:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184979.839307:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fcc540 going to sleep for 11 seconds 00000100:00100000:2.0:1784184979.843918:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265493888:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184979.843965:0:7503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.846168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184979.847470:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239263104 00000100:00100000:1.0:1784184979.847488:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239263104 00010000:00010000:1.0:1784184979.847550:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 54 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184979.847604:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:1.0:1784184979.847615:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+54:2355:x1870853239263104:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184979.847634:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184979.847642:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 54 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.847657:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 54 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.847684:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0754 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f9f expref: 54 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.847706:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:1.0:1784184979.847711:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.847877:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.847889:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.847943:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184979.848024:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+53:2355:x1870853239263104:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 409us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184979.848032:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00010000:00010000:3.0:1784184979.848037:0:7503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.848046:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184979.848104:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784184979.848109:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784184979.848134:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.848166:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0769 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 53 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.848179:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 52 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.848184:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784184979.848187:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784184979.848189:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d800, rc 0) 00000100:00100000:3.0:1784184979.848212:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+52:10535:x1870853239262976:12345-192.168.201.29@tcp:101:bash.0 Request processed in 9424us (9610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184979.848225:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:3.0:1784184979.851392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.851524:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239263360 00000100:00100000:0.0:1784184979.851537:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239263360 00000100:00100000:0.0:1784184979.851604:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1784184979.851617:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+52:10535:x1870853239263360:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1784184979.852013:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+53:10535:x1870853239263360:12345-192.168.201.29@tcp:35:bash.0 Request processed in 399us (636us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1784184979.852020:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1784184979.914639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.916652:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239263488 00000100:00100000:2.0:1784184979.916671:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239263488 00000100:00100000:2.0:1784184979.916768:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:2.0:1784184979.916779:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+53:10541:x1870853239263488:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184979.916811:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184979.916846:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fad expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.916933:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b077e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.916967:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.916980:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184979.917052:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1784184979.917056:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184979.917078:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.917104:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b0777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fad expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.917124:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b077e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fad expref: 54 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.917133:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184979.917136:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784184979.917140:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158ce00, rc 0) 00000100:00100000:2.0:1784184979.917227:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+54:10541:x1870853239263488:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 450us (2612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184979.917234:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:0.0:1784184979.927691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184979.929681:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239263616 00000100:00100000:1.0:1784184979.929701:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239263616 00000100:00100000:1.0:1784184979.931717:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:1.0:1784184979.931756:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+54:10541:x1870853239263616:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184979.931786:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184979.931817:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0785 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fb4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932157:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932177:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932192:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932209:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932239:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932247:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932489:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932499:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932507:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184979.932554:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784184979.932560:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784184979.932583:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932597:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932607:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932614:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932622:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932639:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184979.932645:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932654:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932670:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:1.0:1784184979.932673:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184979.932680:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932687:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b078c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932702:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932709:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932716:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932722:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784184979.932724:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932730:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932748:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f8c4f5d00) 00010000:00010000:1.0:1784184979.932750:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784184979.932753:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932760:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932796:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b0785 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932811:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184979.932820:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:1.0:1784184979.932822:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784184979.932825:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9800, rc 0) 00000100:00100000:1.0:1784184979.933182:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10541:x1870853239263616:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1448us (5502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184979.933192:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:2.0:1784184979.941741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.941850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.941890:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239264000 00000100:00100000:2.0:1784184979.941911:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239264000 00000100:00100000:2.0:1784184979.941987:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:2.0:1784184979.941998:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10541:x1870853239264000:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184979.942040:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184979.942069:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fbb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.942200:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.942219:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 56 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.942228:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.942237:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.942294:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.942310:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 56 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.942327:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265494016:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184979.942504:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 56 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.942513:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 56 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.942537:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265494144:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184979.942582:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fcc480 going to sleep for 11 seconds 00000100:00100000:0.0:1784184979.944392:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239263744 00000100:00100000:0.0:1784184979.944410:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239263744 00010000:00010000:0.0:1784184979.944465:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 57 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.944517:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:0.0:1784184979.944589:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+57:2356:x1870853239263744:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184979.944607:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184979.944616:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 57 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.944631:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 57 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.944657:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184979.944664:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.944688:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.944695:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184979.944780:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+57:2356:x1870853239263744:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 192us (3055us total) trans 0 rc 0/0 00010000:00010000:2.0:1784184979.945855:0:5793:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.29@tcp) returned -22 from blocking AST (req@00000000416efe4e x1870853265494016) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 57 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.945876:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b079a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fb4 expref: 57 pid: 5794 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184979.945907:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265494016:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184979.945925:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265494144:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184979.945955:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184979.945960:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.945968:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.945978:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184979.947869:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.948242:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239264128 00000100:00100000:2.0:1784184979.948252:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239264128 00010000:00010000:2.0:1784184979.948313:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 57 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184979.948615:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:0.0:1784184979.948665:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1784184979.948678:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+56:2356:x1870853239264128:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184979.948698:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184979.948706:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 56 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.948720:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 56 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.948795:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fa6 expref: 56 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.948812:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184979.948816:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.948824:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.948833:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.948887:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184979.948961:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ef3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:2356:x1870853239264128:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 285us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184979.948969:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00010000:00010000:2.0:1784184979.950139:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.950165:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184979.950189:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1784184979.950530:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.950613:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.950719:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184979.950724:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784184979.950728:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c000, rc 0) 00000100:00100000:2.0:1784184979.950809:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10541:x1870853239264000:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 8812us (8956us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1784184979.950820:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:3.0:1784184979.953927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184979.953978:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239264384 00000100:00100000:0.0:1784184979.953992:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239264384 00000100:00100000:0.0:1784184979.954072:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1784184979.954290:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10541:x1870853239264384:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:0.0:1784184979.954313:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184979.954403:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f91 expref: 55 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184979.954424:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184979.954430:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184979.954502:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+54:10541:x1870853239264384:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 420us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184979.954511:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1784184979.956197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184979.956259:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239264512 00000100:00100000:3.0:1784184979.956268:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239264512 00000100:00100000:3.0:1784184979.956365:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:3.0:1784184979.956376:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+54:10541:x1870853239264512:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:3.0:1784184979.956652:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.956674:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184979.956688:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784184979.957522:0:7503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1784184979.957794:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+54:10541:x1870853239264512:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 1416us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184979.957806:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:0.0:1784184979.961945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184979.962255:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239264640 00000100:00100000:2.0:1784184979.962267:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239264640 00000100:00100000:2.0:1784184979.962365:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:2.0:1784184979.962378:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+54:10541:x1870853239264640:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184979.962511:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184979.962600:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fc2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.962682:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.962690:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.962708:0:5792:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.962718:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.962731:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184979.962734:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784184979.962737:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184979.962745:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158ca00, rc 0) 00000100:00100000:2.0:1784184979.962821:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10541:x1870853239264640:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 446us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184979.962829:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 111 00010000:00010000:2.0:1784184979.978534:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784184980.107305:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784184980.107320:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784184980.107981:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1784184980.107998:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784184980.108146:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265494272:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784184980.108291:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83fccd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784184980.117479:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265494272:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784184980.119417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184980.119529:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239264768 00000100:00100000:1.0:1784184980.119549:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239264768 00000100:00100000:1.0:1784184980.119647:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:1.0:1784184980.119660:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10542:x1870853239264768:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784184980.119702:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784184980.119843:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10542:x1870853239264768:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 185us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184980.119872:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00080000:0.0:1784184980.120449:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184980.124505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.127025:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239264896 00000100:00100000:2.0:1784184980.127044:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239264896 00000100:00100000:2.0:1784184980.127149:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:2.0:1784184980.127162:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10542:x1870853239264896:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784184980.127263:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.127295:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.127310:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.132266:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.132304:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.132318:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.132373:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.132382:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.132388:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184980.134306:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784184980.134316:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184980.134358:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134376:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134382:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134388:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134394:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158da00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184980.134398:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134425:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134441:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:2.0:1784184980.134444:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184980.134448:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134454:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b07c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134470:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134495:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134501:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134505:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184980.134508:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134514:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134521:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b5f988b7200) 00010000:00010000:2.0:1784184980.134524:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184980.134526:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134532:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134548:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134553:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134558:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134561:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184980.134569:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134574:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134580:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184980.134583:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184980.134585:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.134590:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184980.137983:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10542:x1870853239264896:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 7525us (10194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.138006:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:1.0:1784184980.145510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.145614:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239265152 00000100:00100000:0.0:1784184980.145630:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239265152 00000100:00100000:0.0:1784184980.145714:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:0.0:1784184980.145727:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+55:10542:x1870853239265152:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784184980.145771:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184980.145794:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b07d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fc9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.145902:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.145917:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.145928:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184980.146189:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784184980.146316:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146324:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146329:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146381:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184980.146385:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146393:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146460:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184980.146471:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784184980.146477:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146483:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b07e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146524:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b07d9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc9 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146534:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:0.0:1784184980.146536:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784184980.146539:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b07d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc9 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.146547:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784184980.147102:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+56:10542:x1870853239265152:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1376us (1606us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1784184980.147111:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:0.0:1784184980.153804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.153902:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239265280 00000100:00100000:2.0:1784184980.153912:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239265280 00000100:00100000:2.0:1784184980.154089:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:2.0:1784184980.154101:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+56:10542:x1870853239265280:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784184980.154137:0:5792:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784184980.154245:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+56:10542:x1870853239265280:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 147us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.154253:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:3.0:1784184980.159819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.160147:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239265536 00000100:00100000:2.0:1784184980.160157:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239265536 00000100:00100000:2.0:1784184980.160208:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:2.0:1784184980.160219:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+56:10542:x1870853239265536:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784184980.160252:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184980.160255:0:7503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784184980.160296:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b077e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fad expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.160315:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:2.0:1784184980.160320:0:7503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784184980.160368:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fd0 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784184980.160744:0:7503:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1784184980.160911:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.160921:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.160928:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.160973:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b07ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd0 expref: 58 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.160984:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd0 expref: 57 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.160989:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f988b7200) 00010000:00010000:2.0:1784184980.160991:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184980.160999:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c200, rc 0) 00000100:00100000:2.0:1784184980.161063:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+57:10542:x1870853239265536:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 845us (1251us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1784184980.161071:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:1.0:1784184980.170658:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265494400:0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.170679:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265494656:0@lo:400:kworker.0 00000100:00100000:1.0:1784184980.170783:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184980.170810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184980.170874:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784184980.170878:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265494912:0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.170889:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265494528:0@lo:400:kworker.0 00000100:00100000:1.0:1784184980.170922:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184980.171252:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265494400 00000100:00100000:0.0:1784184980.171261:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265494400 00000100:00100000:0.0:1784184980.171324:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1784184980.171359:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265494400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184980.171570:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265494784:0@lo:400:kworker.0 00000004:00080000:2.0:1784184980.176211:0:7812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378341875202ns, next at 379341872256ns, rc = 0 00000100:00100000:2.0:1784184980.176248:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784184980.176269:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265495168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184980.176431:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265494400:12345-0@lo:400:kworker.0 Request processed in 5097us (5647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.176444:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1784184980.176514:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184980.176558:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265495040:0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.176587:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184980.176631:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265495040 00000100:00100000:0.0:1784184980.176639:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265495040 00000100:00100000:0.0:1784184980.176696:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784184980.176705:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265495040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.176758:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265495040:12345-0@lo:400:kworker.0 Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.176765:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1784184980.176786:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184980.176816:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265495040:0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.176847:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265494656 00000100:00100000:0.0:1784184980.176851:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265494656 00000100:00080000:0.0:1784184980.176867:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184980.176891:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265494912 00000100:00100000:0.0:1784184980.176906:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265494912 00000100:00100000:0.0:1784184980.176925:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265494528 00000100:00100000:0.0:1784184980.176928:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265494528 00000100:00100000:0.0:1784184980.176951:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784184980.176956:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265494656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.176994:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265494656:12345-0@lo:400:kworker.0 Request processed in 37us (6187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.177000:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784184980.177299:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784184980.177306:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265494912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.177365:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265494912:12345-0@lo:400:kworker.0 Request processed in 60us (6444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.177372:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784184980.177383:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784184980.177389:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265494528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.177418:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265494528:12345-0@lo:400:kworker.0 Request processed in 29us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.177424:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1784184980.177439:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184980.177457:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265494528:0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.177468:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265494656:0@lo:400:kworker.0 00000100:00100000:3.0:1784184980.177835:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184980.178422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.178461:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265494784 00000100:00100000:0.0:1784184980.178468:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265494784 00000100:00100000:0.0:1784184980.178499:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784184980.178506:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1870853265494784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184980.178564:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1870853265494784:12345-0@lo:400:kworker.0 Request processed in 57us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.178570:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784184980.178867:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239265792 00000100:00100000:3.0:1784184980.178872:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239265792 00000100:00100000:3.0:1784184980.178919:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1784184980.178927:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+57:10542:x1870853239265792:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784184980.178980:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184980.179003:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b07f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd0 expref: 57 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179047:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f988b7200) 00010000:00010000:3.0:1784184980.179058:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184980.179078:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179090:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179099:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179155:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179163:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179169:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179248:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179257:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179264:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179271:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184980.179275:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184980.179350:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265494912:0@lo:400:kworker.0 00000100:00100000:1.0:1784184980.179372:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265494400:0@lo:400:kworker.0 00010000:00010000:3.0:1784184980.179818:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179829:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784184980.179832:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184980.179836:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179842:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0803 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179854:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179859:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179865:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179870:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ee00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184980.179873:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179878:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179884:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xccc979a1 (ffff9b5f93b83a00) 00010000:00010000:3.0:1784184980.179887:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184980.179889:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.179915:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b080a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xccc979a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.180021:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+56:10542:x1870853239265792:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1085us (1590us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784184980.180029:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1784184980.180083:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265494784:0@lo:400:kworker.0 00000100:00100000:1.0:1784184980.183773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.184167:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239265920 00000100:00100000:0.0:1784184980.184178:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239265920 00000100:00100000:0.0:1784184980.184241:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:0.0:1784184980.184250:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+56:10542:x1870853239265920:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784184980.184299:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184980.184325:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0811 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fd7 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184980.185164:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784184980.185733:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.185749:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.185760:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.185872:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 58 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.185892:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 57 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.185901:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:0.0:1784184980.185904:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784184980.185908:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d200, rc 0) 00000100:00100000:0.0:1784184980.185962:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+57:10542:x1870853239265920:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1712us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.185970:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:3.0:1784184980.193122:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265495168 00000100:00100000:3.0:1784184980.193139:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265495168 00000100:00100000:3.0:1784184980.193276:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784184980.193297:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265495168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784184980.193354:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184980.193657:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265495168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 363us (8494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184980.193665:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784184980.193958:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265495168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184980.198047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.198214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239266176 00000100:00100000:3.0:1784184980.198225:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239266176 00000100:00100000:3.0:1784184980.198295:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:3.0:1784184980.198304:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+57:10542:x1870853239266176:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784184980.198439:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.198457:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.198470:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784184980.198905:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1784184980.198997:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fcae90ef reply state 0000000086ef7818 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.199008:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784184980.199265:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+59:10542:x1870853239266176:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 960us (1226us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1784184980.199273:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00010000:00010000:3.0:1784184980.207979:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.207997:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.208006:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.208081:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184980.208089:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.208098:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.208117:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:3.0:1784184980.208120:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784184980.208125:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.208131:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b081f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184980.208712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.208834:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239266304 00000100:00100000:3.0:1784184980.208891:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239266304 00000100:00100000:3.0:1784184980.208951:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1784184980.208961:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+58:10542:x1870853239266304:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784184980.208993:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184980.209012:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fde expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.209077:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 59 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.209092:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 59 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.209111:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:3.0:1784184980.209114:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784184980.209117:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ee00, rc 0) 00000100:00100000:3.0:1784184980.209181:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+59:10542:x1870853239266304:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 220us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184980.209188:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:0.0:1784184980.215569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.215736:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239266432 00000100:00100000:2.0:1784184980.215747:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239266432 00000100:00100000:2.0:1784184980.215824:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:2.0:1784184980.215835:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239266432:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784184980.216210:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784184980.216828:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239266432:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 992us (1265us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784184980.216838:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1784184980.228241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.228453:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239266688 00000100:00100000:2.0:1784184980.228463:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239266688 00000100:00100000:2.0:1784184980.228574:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1784184980.228584:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+59:10542:x1870853239266688:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784184980.228873:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+60:10542:x1870853239266688:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 289us (651us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1784184980.228882:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:1.0:1784184980.232475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.232663:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239266944 00000100:00100000:0.0:1784184980.232673:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239266944 00000100:00100000:0.0:1784184980.232787:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:0.0:1784184980.232799:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:10542:x1870853239266944:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784184980.232929:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:10542:x1870853239266944:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 133us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.232937:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:3.0:1784184980.239632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.239806:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239267072 00000100:00100000:0.0:1784184980.239817:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239267072 00000100:00100000:0.0:1784184980.239883:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:0.0:1784184980.239894:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+60:10542:x1870853239267072:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784184980.239984:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184980.240008:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b082d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fe5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.240160:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.240176:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.240188:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184980.240228:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184980.240248:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.240274:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b082d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fe5 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.240327:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fe5 expref: 61 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.241698:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:0.0:1784184980.241701:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784184980.241705:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631dc00, rc 0) 00000100:00100000:2.0:1784184980.242792:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+61:10542:x1870853239267072:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2893us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.242803:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:1.0:1784184980.248079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.248162:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239267200 00000100:00100000:0.0:1784184980.248173:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239267200 00000100:00100000:0.0:1784184980.248241:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1784184980.248251:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faefa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2354:x1870853239267200:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784184980.248270:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184980.248303:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186fec expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784184980.248362:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a588093, blocks: 0x1 00010000:00010000:0.0:1784184980.248382:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1784184980.248386:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184980.248396:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 10 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.248415:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 10 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.248427:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784184980.248483:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faefa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2354:x1870853239267200:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 232us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.248501:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1784184980.269225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.269396:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239267456 00000100:00100000:0.0:1784184980.269406:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239267456 00000100:00100000:0.0:1784184980.269469:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:0.0:1784184980.269479:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:10542:x1870853239267456:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784184980.269596:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:10542:x1870853239267456:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 118us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.269603:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:1.0:1784184980.275518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.276005:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239267584 00000100:00100000:3.0:1784184980.276018:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239267584 00000100:00100000:3.0:1784184980.276099:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1784184980.276110:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+10:10542:x1870853239267584:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784184980.276153:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184980.276179:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ff3 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.276224:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 11 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.276236:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784184980.276241:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784184980.276248:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.276307:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 11 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.276323:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 11 pid: 6588 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.276403:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1870853265495296:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184980.277073:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784184980.293731:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1870853265495296:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184980.293786:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.293814:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e000, rc 0) 00000100:00100000:0.0:1784184980.294038:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+11:10542:x1870853239267584:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 17928us (18534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.294050:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:1.0:1784184980.294566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.298620:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239267712 00000100:00100000:0.0:1784184980.298639:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239267712 00010000:00010000:0.0:1784184980.298705:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 11 pid: 6588 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184980.298774:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1784184980.298786:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+11:2356:x1870853239267712:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184980.298807:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184980.299514:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 11 pid: 6588 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.299683:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 11 pid: 6588 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.299718:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b083b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fec expref: 11 pid: 6588 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.299741:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184980.299746:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184980.299757:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.299769:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.300084:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184980.300106:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1870853265495424:192.168.201.29@tcp:105: 00000100:00100000:0.0:1784184980.300249:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8341ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184980.306909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.307171:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239267840 00000100:00100000:3.0:1784184980.307183:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239267840 00002000:00100000:3.0:1784184980.307250:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b5fb8c9bb80 x1870853239267840/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:701/0 lens 504/0 e 0 to 0 dl 1784184991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784184980.307263:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb8c9bb80 with x1870853239267840 ext(0->12) 00002000:00010000:3.0:1784184980.307269:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fb8c9bb80 00000100:00100000:3.0:1784184980.307353:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1784184980.307365:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+11:2355:x1870853239267840:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784184980.308186:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1870853265495424:192.168.201.29@tcp:105: 00010000:00010000:0.0:1784184980.308217:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184980.308297:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2356:x1870853239267712:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 9514us (13743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.308319:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:3.0:1784184980.311138:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+12:2355:x1870853239267840:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 3760us (4233us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1784184980.311157:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00002000:00100000:3.0:1784184980.311176:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b5fb8c9bb80 x1870853239267840/t4294967308(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:701/0 lens 504/448 e 0 to 0 dl 1784184991 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784184980.311187:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb8c9bb80 with x1870853239267840 ext(0->12) 00002000:00010000:3.0:1784184980.311195:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fb8c9bb80 00000100:00100000:1.0:1784184980.316775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.319617:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239267968 00000100:00100000:2.0:1784184980.319638:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239267968 00000100:00100000:2.0:1784184980.319745:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:2.0:1784184980.319759:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+61:10542:x1870853239267968:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784184980.408721:0:11824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:0.0:1784184980.408771:0:11824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5f91fd6480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1784184980.408778:0:11824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f87f39400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f91fd6180 00000020:00080000:0.0:1784184980.408781:0:11824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f87f39300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fbf43cc00 00000001:00080000:0.0:1784184980.408827:0:11824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1784184980.408836:0:11824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1784184980.408880:0:11824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1784184980.408997:0:11823:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1784184980.409017:0:11823:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5fb9249cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1784184980.409021:0:11823:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f8566c100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fb92493c0 00000020:00080000:2.0:1784184980.409024:0:11823:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f8566cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f8c6a5000 00000100:00100000:2.0:1784184980.409310:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265495552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784184980.409717:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784184980.409821:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265495552 00000100:00100000:2.0:1784184980.409830:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265495552 00000100:00100000:2.0:1784184980.409886:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784184980.410042:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+15:10542:x1870853239267968:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 90282us (93276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184980.410054:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000020:00080000:1.0:1784184980.410355:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1784184980.410724:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1870853265495552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784184980.410763:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1784184980.410807:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a588092, atime: 0x6a588093, ctime: 0x6a588092, blocks: 0x1 00010000:00010000:2.0:1784184980.410817:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.410839:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1784184980.410844:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184980.410852:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.410871:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784184980.411025:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1784184980.411224:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265495680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784184980.411303:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184980.411686:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265495680 00000100:00100000:0.0:1784184980.411694:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265495680 00000100:00100000:0.0:1784184980.411749:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784184980.411758:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265495680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784184980.411779:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1784184980.411802:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.411823:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 11 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.411833:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784184980.411838:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784184980.411842:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.411878:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 11 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.412057:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.412065:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.412198:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 11 pid: 6589 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184980.412213:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265495808:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184980.412297:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8341ae40 going to sleep for 11 seconds 00010000:00010000:2.0:1784184980.412362:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784184980.415409:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3315:x1870853265495552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4680us (5679us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784184980.415618:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1784184980.416080:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fbfbcfb80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1784184980.416091:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265495552:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1784184980.417544:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784184980.417655:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.417673:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158ce00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784184980.417680:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.417693:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.417721:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.417847:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b0849 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.417878:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184980.417880:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784184980.417882:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184980.425491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.425752:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239268096 00000100:00100000:3.0:1784184980.425762:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239268096 00000100:00100000:3.0:1784184980.425814:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1784184980.425814:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265495808:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184980.425826:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+12:2354:x1870853239268096:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1784184980.425859:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184980.430570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.431102:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239268224 00000100:00100000:3.0:1784184980.431116:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239268224 00010000:00010000:3.0:1784184980.431153:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 13 pid: 6589 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.431187:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1784184980.431193:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2355:x1870853239268224:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184980.431204:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184980.431209:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 13 pid: 6589 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.431219:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 13 pid: 6589 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.431237:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b060b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838186f52 expref: 13 pid: 6589 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.431260:0:7492:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784184980.431264:0:7492:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784184980.431269:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.431288:0:7492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.431322:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184980.431371:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.431388:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.431403:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.431422:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.431480:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784184980.432030:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+12:2355:x1870853239268224:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 833us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184980.432039:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1784184980.432979:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1870853265495680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21215us (21669us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784184980.432994:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1784184980.433034:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784184980.433042:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.433053:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784184980.433058:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.433070:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.433091:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.433099:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0850 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.433191:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184980.433193:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184980.433195:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784184980.433655:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fb8c9a300/2, rc 0, transno 4294967309 00000100:00100000:2.0:1784184980.433686:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265495680:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1784184980.463395:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1784184980.463418:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1784184980.463425:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1784184980.463437:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1784184980.463650:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239268096:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 37810us (38152us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.463667:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1784184980.473013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.473714:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239268480 00000100:00100000:3.0:1784184980.473730:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239268480 00000100:00100000:3.0:1784184980.473816:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:3.0:1784184980.473829:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+15:10542:x1870853239268480:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784184980.473903:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184980.473940:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fe5 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.473965:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:3.0:1784184980.473972:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184980.474013:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.474030:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.474060:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784184980.474482:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000381df323 reply state 000000003bdf8cce transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.474495:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784184980.474633:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+16:10542:x1870853239268480:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 805us (1628us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1784184980.474642:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1784184980.488405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:2.0:1784184980.488409:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.488439:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.488448:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.488455:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184980.488461:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.488489:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.488510:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:2.0:1784184980.488513:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184980.488519:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.488526:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0857 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.488556:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239268608 00000100:00100000:3.0:1784184980.488568:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239268608 00000100:00100000:3.0:1784184980.488629:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1784184980.488640:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239268608:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784184980.488844:0:10137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784184980.488848:0:10137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784184979 00002000:00010000:3.0:1784184980.488851:0:10137:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784184979 00002000:00010000:3.0:1784184980.488853:0:10137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1784184979 -> 1784184979 00002000:00010000:3.0:1784184980.488855:0:10137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784184980.488910:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239268608:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 273us (518us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1784184980.488917:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1784184980.491902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.492079:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239268864 00000100:00100000:3.0:1784184980.492092:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239268864 00000100:00100000:3.0:1784184980.492164:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:3.0:1784184980.492174:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+15:10542:x1870853239268864:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784184980.492269:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.492384:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 15 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.492395:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.492433:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 15 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.492448:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 15 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.492463:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265495936:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184980.492565:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784184980.502022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.502084:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265495936:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184980.502118:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184980.502399:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239268992 00000100:00100000:1.0:1784184980.502421:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239268992 00010000:00010000:1.0:1784184980.502487:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 16 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184980.502528:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1784184980.502538:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:2356:x1870853239268992:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184980.502558:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184980.502565:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 16 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.502578:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 16 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.502606:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fd7 expref: 16 pid: 7503 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.502624:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:1.0:1784184980.502630:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.502641:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.502670:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.502706:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184980.502754:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.502765:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184980.502780:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+15:2356:x1870853239268992:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 241us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184980.502789:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00010000:00010000:3.0:1784184980.502994:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.503018:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.503025:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.503031:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184980.503035:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.503042:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.503058:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:3.0:1784184980.503061:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784184980.503065:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.503071:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b085e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.503159:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10542:x1870853239268864:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 10984us (11268us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784184980.503169:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:0.0:1784184980.506951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.507469:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239269120 00000100:00100000:2.0:1784184980.507485:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239269120 00000100:00100000:2.0:1784184980.507586:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1784184980.507595:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239269120:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784184980.507636:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.507655:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.507664:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184980.507669:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784184980.507674:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.507706:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.507741:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 7 pid: 6590 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184980.507757:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265496064:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184980.507842:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784184980.511687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.512223:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265496064:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184980.512253:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239269248 00010000:00010000:2.0:1784184980.512255:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184980.512270:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239269248 00010000:00010000:0.0:1784184980.512415:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 8 pid: 6590 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184980.512483:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:0.0:1784184980.512496:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239269248:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184980.512518:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184980.512551:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 8 pid: 6590 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.512572:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 8 pid: 6590 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.512603:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b0842 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838186ff3 expref: 8 pid: 6590 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.512624:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784184980.512629:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784184980.512635:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.512648:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.512822:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184980.512899:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239269248:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 395us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.512909:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00010000:00010000:0.0:1784184980.516583:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.516607:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.516777:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.516787:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.516797:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.516803:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784184980.516807:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.516833:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.516851:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.516860:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d56208/0x63160f6fbe8b0865 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184980.516976:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239269120:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 9377us (10036us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.516987:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1784184980.520168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.520661:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239269504 00000100:00100000:3.0:1784184980.520672:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239269504 00000100:00100000:2.0:1784184980.520823:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:2.0:1784184980.520833:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10542:x1870853239269504:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784184980.520917:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.520935:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.520946:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.521142:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.521153:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.521172:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.521205:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.521216:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 15 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184980.521229:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbce300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265496192:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184980.521328:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902fed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784184980.524749:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184980.524834:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239269632 00000100:00100000:1.0:1784184980.524842:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239269632 00010000:00010000:1.0:1784184980.524881:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 16 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184980.524929:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1784184980.524938:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:2355:x1870853239269632:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184980.524951:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184980.524958:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 16 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.524970:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 16 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.524989:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:1.0:1784184980.524994:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.525019:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.525026:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.525046:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184980.525098:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:2355:x1870853239269632:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 160us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184980.525105:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00010000:00010000:3.0:1784184980.525547:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b0826 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fde expref: 15 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.525569:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbce300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265496192:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184980.525595:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.525602:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.525607:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784184980.525787:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1784184980.525947:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1784184980.525992:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1784184980.526086:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265496320:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784184980.526136:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184980.526170:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249300 going to sleep for 11 seconds 00000100:00100000:2.0:1784184980.527044:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265496320 00000100:00100000:2.0:1784184980.527054:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265496320 00000100:00100000:2.0:1784184980.527102:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784184980.527112:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1870853265496320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784184980.527208:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1870853265496320:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.527216:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784184980.527579:0:5794:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1784184980.527586:0:5794:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1784184980.527607:0:5794:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b5fb8c9a300 x1870853265495680/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784184996 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784184980.527620:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265496320:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1784184980.528236:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1784184980.528320:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265496448:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784184980.528842:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184980.528922:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784184980.529978:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265496448 00000100:00100000:2.0:1784184980.529989:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265496448 00000100:00100000:2.0:1784184980.530083:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784184980.530093:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1870853265496448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784184980.530385:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5794:x1870853265496448:12345-0@lo:1000:mdt00_002.0 Request processed in 293us (1543us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784184980.530392:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784184980.530489:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265496448:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1784184980.530529:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530563:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530570:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530577:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184980.530582:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530591:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530606:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f87fe3700) 00010000:00010000:3.0:1784184980.530609:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784184980.530614:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530620:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0873 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530659:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530666:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530673:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530678:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184980.530686:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530693:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530702:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784184980.530705:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784184980.530711:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530722:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530730:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.530764:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.530778:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265496576:192.168.201.29@tcp:105: 00000100:00100000:3.0:1784184980.530859:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784184980.535965:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265496576:192.168.201.29@tcp:105: 00010000:00010000:3.0:1784184980.536000:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.536010:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b07b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184980.536314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.536842:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239269760 00000100:00100000:0.0:1784184980.536851:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239269760 00000100:00100000:0.0:1784184980.536926:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:0.0:1784184980.536936:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10541:x1870853239269760:12345-192.168.201.29@tcp:49:lfs.0 00000100:00100000:0.0:1784184980.537085:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:10541:x1870853239269760:12345-192.168.201.29@tcp:49:lfs.0 Request processed in 150us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.537093:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00010000:00010000:2.0:1784184980.539440:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539467:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539480:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539494:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539500:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539507:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539513:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184980.539517:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539525:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539547:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184980.539550:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184980.539555:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539561:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b087a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539575:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539597:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539603:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539607:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184980.539610:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539615:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539622:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184980.539625:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784184980.539627:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.539633:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b086c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184980.539884:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+18:10542:x1870853239269504:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 19048us (19720us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1784184980.539907:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00000020:00080000:2.0:1784184980.539914:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784184980.540418:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784184980.540423:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784184980.540934:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1784184980.540942:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784184980.544584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.544675:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239270016 00000100:00100000:2.0:1784184980.544685:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239270016 00000100:00100000:2.0:1784184980.544745:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:2.0:1784184980.544755:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:10541:x1870853239270016:12345-192.168.201.29@tcp:58:lfs.0 00000040:00080000:2.0:1784184980.545156:0:7503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1784184980.545248:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:10541:x1870853239270016:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 493us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184980.545256:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:3.0:1784184980.547207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184980.547304:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239270272 00000100:00100000:0.0:1784184980.547313:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239270272 00000100:00100000:0.0:1784184980.547402:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1784184980.547411:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:10542:x1870853239270272:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784184980.548290:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784184980.555266:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1784184980.555382:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.555400:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.555412:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.555421:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.555427:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.555433:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184980.555461:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784184980.557687:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784184980.557701:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.557713:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784184980.557717:0:7491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.557726:0:7491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.557743:0:7491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b5f8c4f5d00) 00010000:00010000:2.0:1784184980.557746:0:7491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784184980.557750:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.557756:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0881 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.557781:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184980.557783:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184980.557785:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184980.559991:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:10542:x1870853239270272:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 12568us (12779us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1784184980.560007:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000020:00080000:1.0:1784184980.560015:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784184980.592387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184980.592493:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239270400 00000100:00100000:2.0:1784184980.592502:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239270400 00000100:00100000:2.0:1784184980.592564:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:2.0:1784184980.592574:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:10544:x1870853239270400:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784184980.592613:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184980.592646:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0888 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838186ffa expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.592705:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.592720:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.592731:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.592747:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.592754:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.592761:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.593047:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.593059:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.593067:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.593099:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184980.593117:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 21 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184980.593132:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265496704:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184980.593216:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902fe840 going to sleep for 11 seconds 00000100:00100000:0.0:1784184980.600580:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265496704:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184980.600630:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184980.601495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184980.601917:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239270656 00000100:00100000:1.0:1784184980.601925:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239270656 00000100:00100000:1.0:1784184980.601987:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1784184980.601997:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+22:5571:x1870853239270656:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784184980.602233:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+23:5571:x1870853239270656:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 236us (741us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1784184980.602242:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1784184980.605329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184980.605458:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239270784 00000100:00100000:3.0:1784184980.605469:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239270784 00010000:00010000:3.0:1784184980.605511:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 23 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184980.605563:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1784184980.605573:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f91f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+23:2354:x1870853239270784:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184980.605589:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184980.605596:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 23 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.605610:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 23 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.605644:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b07a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838186fbb expref: 23 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.605661:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784184980.605667:0:7492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.605677:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.605684:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184980.605724:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184980.605787:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f91f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2354:x1870853239270784:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 215us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184980.605795:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00010000:00010000:0.0:1784184980.607002:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607016:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184980.607063:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784184980.607067:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184980.607087:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607102:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607113:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607120:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607127:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607133:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184980.607137:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607143:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607169:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:0.0:1784184980.607172:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184980.607176:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607182:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b088f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607196:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607202:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607208:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607213:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184980.607216:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607221:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607228:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b5f988b7700) 00010000:00010000:0.0:1784184980.607230:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184980.607232:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607237:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b0896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607295:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0888 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ffa expref: 22 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607311:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ffa expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184980.607318:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184980.607321:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184980.607323:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d600, rc 0) 00000100:00100000:0.0:1784184980.607419:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10544:x1870853239270400:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 14845us (15040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184980.607427:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000001:00080000:3.0:1784184980.733080:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:3.0:1784184980.733099:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1784184980.733110:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1784184980.733125:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1784184981.003925:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184981.071100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184981.071145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184981.071183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184981.071214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184981.071238:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184981.071382:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239271296 00000100:00100000:0.0:1784184981.071392:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239271296 00000100:00100000:0.0:1784184981.071441:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239271168 00000100:00100000:0.0:1784184981.071445:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239271168 00000100:00100000:0.0:1784184981.071476:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:0.0:1784184981.071486:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239271296:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184981.071558:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239271296:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184981.071565:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:0.0:1784184981.071581:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:0.0:1784184981.071588:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239271168:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184981.071612:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239271168:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184981.071636:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00080000:0.0:1784184981.071667:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184981.071756:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239270912 00000100:00100000:1.0:1784184981.071760:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239270912 00000100:00100000:1.0:1784184981.071796:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 295 00000100:00100000:1.0:1784184981.071803:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239270912:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184981.071828:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239270912:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184981.071834:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 295 00000100:00100000:2.0:1784184981.072204:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239271040 00000100:00100000:2.0:1784184981.072208:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239271040 00000100:00100000:2.0:1784184981.072289:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239271424 00000100:00100000:2.0:1784184981.072293:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239271424 00000100:00080000:1.0:1784184981.072401:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184981.073476:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:0.0:1784184981.073490:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2356:x1870853239271040:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184981.073649:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 150 00000100:00100000:2.0:1784184981.073659:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239271424:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184981.073708:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2356:x1870853239271040:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 221us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184981.073715:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:2.0:1784184981.079541:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239271424:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 5871us (8287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184981.079559:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 150 00000040:00080000:3.0:1784184981.581370:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784184981.581383:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784184981.581432:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784184981.581439:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784184981.581610:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265496832:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784184981.581741:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784184981.589995:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265496832:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784184981.590670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184981.590752:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239271552 00000100:00100000:1.0:1784184981.590762:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239271552 00000100:00100000:1.0:1784184981.590848:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:1.0:1784184981.590859:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10556:x1870853239271552:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784184981.590931:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784184981.591078:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10556:x1870853239271552:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 219us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184981.591086:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:0.0:1784184981.597482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184981.597674:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239271808 00000100:00100000:3.0:1784184981.597688:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239271808 00000100:00100000:3.0:1784184981.597767:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1784184981.597781:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+21:10556:x1870853239271808:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784184981.597821:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184981.597852:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b08a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187001 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.598005:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b08ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.598025:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b08ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.598056:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b08ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184981.598072:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784184981.598483:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b08a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187001 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.598510:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b08ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187001 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.598521:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784184981.598525:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784184981.598530:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896fa00, rc 0) 00000100:00100000:3.0:1784184981.598622:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+23:10556:x1870853239271808:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 843us (1157us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1784184981.598631:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:1.0:1784184981.608303:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184981.608675:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184981.612743:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239271936 00000100:00100000:0.0:1784184981.612765:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239271936 00000100:00100000:0.0:1784184981.614620:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1784184981.614657:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+23:2354:x1870853239271936:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184981.614684:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184981.614723:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b08ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187001 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184981.614748:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:0.0:1784184981.614755:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184981.614866:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2354:x1870853239271936:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 221us (6575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184981.615372:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1784184981.615620:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239272192 00000100:00100000:2.0:1784184981.615631:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239272192 00000100:00100000:2.0:1784184981.615698:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:2.0:1784184981.615707:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+22:10556:x1870853239272192:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784184981.615837:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.615856:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.615869:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.616154:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.616163:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.616171:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.616179:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184981.616184:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.616194:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.616208:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784184981.616212:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784184981.616217:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184981.616224:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b08b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184981.616453:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+23:10556:x1870853239272192:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 745us (7777us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1784184981.616462:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 132 00000040:00080000:2.0:1784184981.617092:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784184981.617112:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784184981.617707:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1784184981.617718:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784184981.635400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184981.635769:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239272448 00000100:00100000:3.0:1784184981.635784:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239272448 00000100:00100000:3.0:1784184981.635872:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1784184981.635886:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+23:10556:x1870853239272448:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784184981.636222:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+24:10556:x1870853239272448:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 338us (834us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1784184981.636232:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000040:00080000:3.0:1784184981.713525:0:11918:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784184981.713540:0:11918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784184981.713598:0:11918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784184981.713612:0:11918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784184981.719958:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784184981.719991:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265496960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784184981.720099:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184981.720311:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265496960 00000100:00100000:3.0:1784184981.720321:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265496960 00000100:00100000:3.0:1784184981.720420:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784184981.720432:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265496960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184981.720480:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784184981.721037:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784184981.721139:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8f16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265496960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 708us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184981.721148:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784184981.722381:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1784184981.722393:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1784184981.722418:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5f84466d80, transno 4294967301 00000004:00080000:0.0:1784184981.722437:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1784184981.722449:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fbfbcfb80, transno 4294967304 00000100:00100000:0.0:1784184981.722471:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265496960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184981.979302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184981.979556:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239272704 00000100:00100000:3.0:1784184981.979572:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239272704 00000100:00100000:3.0:1784184981.979656:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:3.0:1784184981.979667:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+24:10569:x1870853239272704:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784184981.979711:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184981.979739:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b08c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187008 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.979887:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b08c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.979906:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b08c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.979922:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b08c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184981.979935:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784184981.980115:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b08c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187008 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.980165:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b08c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187008 expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.980187:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784184981.980190:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784184981.980195:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ee00, rc 0) 00000100:00100000:3.0:1784184981.980399:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+26:10569:x1870853239272704:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 733us (1112us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1784184981.980408:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:1.0:1784184981.985401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184981.985595:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239272832 00000100:00100000:3.0:1784184981.985610:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239272832 00000100:00100000:3.0:1784184981.985691:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:3.0:1784184981.985715:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+26:10569:x1870853239272832:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1784184981.985813:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985836:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985877:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985917:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985924:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985950:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985957:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184981.985963:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985971:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.985996:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784184981.986000:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784184981.986006:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184981.986011:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b08d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184981.986114:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+26:10569:x1870853239272832:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 402us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184981.986123:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 134 00010000:00010000:0.0:1784184982.027550:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184982.150606:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184982.150729:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239272960 00000100:00100000:0.0:1784184982.150745:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239272960 00000100:00080000:1.0:1784184982.150812:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184982.150838:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:0.0:1784184982.150852:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239272960:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1784184982.150876:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184982.150906:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b08dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818700f expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784184982.150944:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a588093, atime: 0x6a588093, ctime: 0x6a588093, blocks: 0xb 00010000:00010000:0.0:1784184982.150969:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1784184982.150974:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184982.150987:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b08dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818700f expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184982.151010:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b08dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818700f expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184982.151027:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d800, rc 0) 00000100:00100000:0.0:1784184982.151100:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239272960:12345-192.168.201.29@tcp:101:cat.0 Request processed in 253us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184982.151118:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1784184982.162471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184982.162536:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239273088 00000100:00100000:1.0:1784184982.162549:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239273088 00002000:00100000:1.0:1784184982.162633:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b5fb8c98700 x1870853239273088/t0(0) o3->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:703/0 lens 488/0 e 0 to 0 dl 1784184993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784184982.162647:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb8c98700 with x1870853239273088 ext(0->4095) 00002000:00010000:1.0:1784184982.162653:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fb8c98700 00000100:00100000:1.0:1784184982.162688:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1784184982.162700:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2354:x1870853239273088:12345-192.168.201.29@tcp:3:cat.0 00000100:00100000:1.0:1784184982.162994:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2354:x1870853239273088:12345-192.168.201.29@tcp:3:cat.0 Request processed in 296us (538us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1784184982.163002:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00002000:00100000:1.0:1784184982.163010:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b5fb8c98700 x1870853239273088/t0(0) o3->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:703/0 lens 488/4536 e 0 to 0 dl 1784184993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784184982.163042:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fb8c98700 with x1870853239273088 ext(0->4095) 00002000:00010000:1.0:1784184982.163046:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fb8c98700 00010000:00010000:2.0:1784184983.050498:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184984.074678:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184985.101249:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784184985.290665:0:7812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383456328864ns, next at 384456325093ns, rc = 0 00000100:00100000:1.0:1784184985.290761:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184985.290790:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265497088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184985.290886:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184985.291173:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265497216:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291218:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184985.291242:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbb0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265497728:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291266:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184985.291284:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784184985.291289:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265497344:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291307:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184985.291366:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497216 00000100:00100000:1.0:1784184985.291375:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497216 00000100:00100000:1.0:1784184985.291438:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784184985.291447:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265497216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291499:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265497216:12345-0@lo:400:kworker.0 Request processed in 53us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184985.291507:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784184985.291541:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497728 00000100:00100000:1.0:1784184985.291544:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497728 00000100:00100000:1.0:1784184985.291577:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497344 00000100:00100000:1.0:1784184985.291579:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497344 00000100:00100000:1.0:1784184985.291596:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784184985.291601:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265497728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291648:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265497728:12345-0@lo:400:kworker.0 Request processed in 47us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184985.291654:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784184985.291664:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784184985.291669:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265497344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291689:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265497344:12345-0@lo:400:kworker.0 Request processed in 20us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184985.291694:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1784184985.291714:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184985.291751:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265497344:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291760:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265497216:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291768:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbb0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265497728:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291793:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265497472:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291812:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184985.291826:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784184985.291831:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265497600:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291850:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184985.291873:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497600 00000100:00100000:1.0:1784184985.291876:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497600 00000100:00100000:1.0:1784184985.291915:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784184985.291922:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265497600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.291952:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265497600:12345-0@lo:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184985.291957:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1784184985.291978:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184985.291984:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497472 00000100:00100000:1.0:1784184985.291987:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497472 00000100:00100000:1.0:1784184985.292004:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784184985.292010:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265497472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.292032:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265497472:12345-0@lo:400:kworker.0 Request processed in 22us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184985.292038:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1784184985.292048:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184985.292060:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265497600:0@lo:400:kworker.0 00000100:00100000:1.0:1784184985.292068:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265497472:0@lo:400:kworker.0 00000100:00100000:2.0:1784184985.293321:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497088 00000100:00100000:2.0:1784184985.293350:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497088 00000100:00100000:2.0:1784184985.293423:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784184985.293433:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265497088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184985.293479:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184985.293569:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265497088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184985.293577:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784184985.293639:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265497088:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784184985.293789:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1784184985.895445:0:11823:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:0.0:1784184985.895485:0:11823:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:0.0:1784184985.895492:0:11823:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:0.0:1784184985.895508:0:11823:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1784184985.895526:0:11823:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:0.0:1784184985.895536:0:11823:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1784184985.895550:0:11823:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5fb9249300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1784184985.895556:0:11823:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f8566c500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fb92496c0 00000020:00080000:0.0:1784184985.895560:0:11823:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f8566cb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f85962000 00000020:00080000:0.0:1784184985.895681:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1784184985.896038:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1784184985.896132:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265497856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784184985.896232:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184985.896327:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497856 00000100:00100000:0.0:1784184985.896380:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497856 00000100:00100000:0.0:1784184985.896441:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784184985.896452:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1870853265497856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1784184985.896685:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1784184985.896690:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1784184979 -> 1784184979 00002000:00010000:0.0:1784184985.896692:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1784184979 -> 1784184979 00002000:00010000:0.0:1784184985.896695:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1784184979 -> 1784184979 00002000:00010000:0.0:1784184985.896698:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1784184985.896744:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3316:x1870853265497856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 293us (511us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784184985.896774:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1784184985.899058:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fbf5ec380/2, rc 0, transno 4294967312 00000100:00100000:0.0:1784184985.899081:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265497856:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1784184985.909097:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1784184985.909176:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1784184985.909304:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1784184986.122595:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184986.203002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184986.204106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184986.204160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184986.204204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184986.204237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184986.204279:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239273728 00000100:00100000:1.0:1784184986.204292:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239273728 00000100:00100000:1.0:1784184986.204500:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239273344 00000100:00100000:1.0:1784184986.204504:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239273344 00000100:00100000:1.0:1784184986.204537:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:1.0:1784184986.204548:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239273728:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184986.204645:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239273728:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 98us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184986.204653:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:1.0:1784184986.204673:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 155 00000100:00100000:1.0:1784184986.204835:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2353:x1870853239273344:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184986.204862:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2353:x1870853239273344:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184986.206102:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239273472 00000100:00100000:2.0:1784184986.206118:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239273472 00000100:00100000:2.0:1784184986.206209:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239273600 00000100:00100000:2.0:1784184986.206213:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239273600 00000100:00100000:2.0:1784184986.206248:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:2.0:1784184986.206257:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239273472:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184986.206370:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239273472:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 113us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184986.206389:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:2.0:1784184986.206408:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:2.0:1784184986.206415:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239273600:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184986.206441:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239273600:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184986.206448:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00080000:2.0:1784184986.206508:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784184986.206513:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784184986.206515:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184986.211282:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239273216 00000100:00100000:0.0:1784184986.211304:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239273216 00000100:00100000:0.0:1784184986.211438:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 297 00000100:00100000:0.0:1784184986.211450:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239273216:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184986.211565:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239273216:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 116us (8577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184986.211573:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 297 00000100:00100000:1.0:1784184986.229143:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 155 00000100:00100000:1.0:1784184986.826953:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784184986.826983:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265497984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184986.827072:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184986.828494:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265497984 00000100:00100000:3.0:1784184986.828510:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265497984 00000100:00100000:3.0:1784184986.828642:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784184986.828655:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265497984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784184986.828704:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784184986.828808:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265497984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184986.828816:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784184986.828904:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265497984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784184987.148374:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184987.656870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184987.657045:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239273856 00000100:00100000:2.0:1784184987.657057:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239273856 00000100:00100000:2.0:1784184987.657129:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:2.0:1784184987.657140:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10230:x1870853239273856:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784184987.657304:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10230:x1870853239273856:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 165us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184987.657312:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:0.0:1784184987.675921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184987.676272:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239274112 00000100:00100000:3.0:1784184987.676300:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239274112 00000100:00100000:3.0:1784184987.676415:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1784184987.676428:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+13:10230:x1870853239274112:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784184987.679230:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:10230:x1870853239274112:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 2780us (3301us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1784184987.679249:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1784184987.996171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184987.996371:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239274240 00000100:00100000:1.0:1784184987.996382:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239274240 00000100:00100000:1.0:1784184987.996462:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:1.0:1784184987.996473:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:11021:x1870853239274240:12345-192.168.201.29@tcp:101:lsof.0 00010000:00010000:1.0:1784184987.996504:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184987.996529:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b08e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187016 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184987.996602:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184987.996614:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184987.996626:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184987.997664:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784184987.997676:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784184987.997985:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184987.998036:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b08e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184987.998060:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184987.998070:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:1.0:1784184987.998074:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784184987.998079:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9200, rc 0) 00000100:00100000:1.0:1784184987.998319:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:11021:x1870853239274240:12345-192.168.201.29@tcp:101:lsof.0 Request processed in 1845us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184987.998328:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 136 00010000:00010000:2.0:1784184988.172062:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784184988.811185:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784184988.811197:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784184988.811239:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784184988.811256:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784184989.196581:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184990.218636:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784184990.410851:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784184990.410885:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265498112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784184990.411062:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184990.411432:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265498624:0@lo:400:kworker.0 00000100:00100000:0.0:1784184990.411472:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184990.411506:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784184990.411511:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265498496:0@lo:400:kworker.0 00000100:00100000:0.0:1784184990.411540:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184990.411582:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265498624 00000100:00100000:0.0:1784184990.411591:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265498624 00000100:00100000:0.0:1784184990.411661:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784184990.411672:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265498624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184990.411752:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265498624:12345-0@lo:400:kworker.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184990.411760:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784184990.411817:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265498496 00000100:00100000:0.0:1784184990.411821:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265498496 00000100:00100000:0.0:1784184990.411854:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784184990.411860:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265498496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184990.411892:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265498496:12345-0@lo:400:kworker.0 Request processed in 32us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184990.411899:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1784184990.411917:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784184990.411922:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784184990.411973:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265498496:0@lo:400:kworker.0 00000100:00100000:0.0:1784184990.411985:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265498624:0@lo:400:kworker.0 00000100:00100000:2.0:1784184990.412370:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265498112 00000100:00100000:2.0:1784184990.412378:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265498112 00000100:00100000:2.0:1784184990.412434:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784184990.412443:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265498112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784184990.412483:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784184990.412532:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265498112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184990.412547:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784184990.412820:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265498240:0@lo:400:kworker.0 00000100:00100000:1.0:1784184990.412865:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184990.412911:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265498752:0@lo:400:kworker.0 00000100:00100000:1.0:1784184990.413001:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184990.413031:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784184990.413038:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265498368:0@lo:400:kworker.0 00000100:00100000:1.0:1784184990.413061:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184990.413087:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265498752 00000100:00100000:1.0:1784184990.413092:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265498752 00000100:00100000:1.0:1784184990.413140:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265498368 00000100:00100000:1.0:1784184990.413143:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265498368 00000100:00100000:1.0:1784184990.413158:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784184990.413164:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265498752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184990.413205:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265498752:12345-0@lo:400:kworker.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184990.413211:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784184990.413224:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784184990.413230:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265498368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184990.413252:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265498368:12345-0@lo:400:kworker.0 Request processed in 23us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184990.413258:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784184990.413290:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265498368:0@lo:400:kworker.0 00000100:00100000:1.0:1784184990.413299:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265498752:0@lo:400:kworker.0 00000100:00080000:0.0:1784184990.413513:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784184990.413519:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184990.413546:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1784184990.413552:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fb8c9a300, transno 4294967309 00000004:00080000:0.0:1784184990.414017:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1784184990.414047:0:3313:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b5fbf5ec380 x1870853265497856/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1784185001 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784184990.414069:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265498112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784184990.414863:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265498240 00000100:00100000:2.0:1784184990.414875:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265498240 00000100:00100000:2.0:1784184990.414950:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1784184990.414961:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265498240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784184990.415058:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265498240:12345-0@lo:400:kworker.0 Request processed in 99us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184990.415066:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784184990.415243:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265498240:0@lo:400:kworker.0 00000001:00080000:0.0:1784184991.049833:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000020:00080000:2.0:1784184991.056504:0:11825:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1784184991.056542:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1784184991.056557:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1784184991.056781:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:2.0:1784184991.243961:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184991.317004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184991.317125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184991.317172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184991.317205:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184991.317237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184991.317290:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239274880 00000100:00100000:1.0:1784184991.317302:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239274880 00000100:00100000:0.0:1784184991.317462:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239274496 00000100:00100000:0.0:1784184991.317467:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239274496 00000100:00100000:0.0:1784184991.317541:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00100000:0.0:1784184991.317553:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2354:x1870853239274496:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184991.317683:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2354:x1870853239274496:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 131us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184991.317691:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00080000:0.0:1784184991.317735:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184991.321696:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:1.0:1784184991.321733:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2354:x1870853239274880:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184991.321841:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2354:x1870853239274880:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 130us (4667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184991.321850:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:1.0:1784184991.321915:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239274624 00000100:00100000:1.0:1784184991.321924:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239274624 00000100:00100000:1.0:1784184991.321968:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239274752 00000100:00100000:1.0:1784184991.321972:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239274752 00000100:00100000:1.0:1784184991.321994:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:1.0:1784184991.322000:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239274624:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184991.322034:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239274624:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 34us (4910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184991.322040:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:1.0:1784184991.322052:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:1.0:1784184991.322058:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239274752:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184991.322080:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239274752:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (4843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184991.322086:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00080000:0.0:1784184991.324033:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784184991.324046:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784184991.329844:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239274368 00000100:00100000:2.0:1784184991.329865:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239274368 00000100:00100000:0.0:1784184991.340944:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 299 00000100:00100000:0.0:1784184991.340962:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239274368:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784184991.341116:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239274368:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 157us (24126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184991.341125:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 299 00000100:00100000:1.0:1784184991.958235:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784184991.958261:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265498880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784184991.958419:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184991.958521:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265498880 00000100:00100000:1.0:1784184991.958529:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265498880 00000100:00100000:1.0:1784184991.958600:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784184991.958611:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265498880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784184991.958652:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184991.958698:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265498880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184991.958705:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784184991.959059:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265498880:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1784184992.027107:0:12121:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:56:30 (1784184990) 00010000:00010000:2.0:1784184992.266600:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184993.291036:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784184993.641892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184993.650899:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239275136 00000100:00100000:0.0:1784184993.650914:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239275136 00000100:00100000:0.0:1784184993.651004:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:0.0:1784184993.651015:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:11286:x1870853239275136:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784184993.651035:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184993.651064:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b08f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818701d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.651135:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.651149:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.651178:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.651194:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.651201:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.651207:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784184993.651783:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784184993.656045:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0906 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656086:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0906 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656099:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0906 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184993.656113:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1784184993.656322:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656351:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656359:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656365:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184993.656375:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656383:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656395:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b5f8296ec00) 00010000:00010000:0.0:1784184993.656398:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184993.656402:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656407:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b08f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656418:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656423:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656428:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656433:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184993.656436:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656442:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656448:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b5f87fe3a00) 00010000:00010000:0.0:1784184993.656450:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184993.656461:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656466:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b08ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656822:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b08f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818701d expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656839:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0906 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818701d expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184993.656847:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:0.0:1784184993.656849:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184993.656852:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784184993.656930:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+15:11286:x1870853239275136:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 5917us (15047us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1784184993.656940:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:3.0:1784184993.676032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184993.676113:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239275264 00000100:00100000:2.0:1784184993.676123:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239275264 00000100:00100000:2.0:1784184993.676197:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1784184993.676209:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+15:2354:x1870853239275264:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784184993.676225:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784184993.676251:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0906 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818701d expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184993.676271:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:2.0:1784184993.676276:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784184993.676382:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+14:2354:x1870853239275264:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 174us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184993.676390:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784184993.681141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184993.681471:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239275392 00000100:00100000:1.0:1784184993.681483:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239275392 00000100:00100000:1.0:1784184993.681543:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:1.0:1784184993.681563:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:11286:x1870853239275392:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784184993.681679:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:11286:x1870853239275392:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 126us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184993.681687:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 138 00000040:00080000:3.0:1784184993.934101:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784184993.934117:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784184993.934164:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784184993.934173:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784184994.316063:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784184995.338766:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784184995.530587:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265499008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784184995.530674:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184995.530714:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265499392:0@lo:400:kworker.0 00000100:00100000:0.0:1784184995.530726:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265499520:0@lo:400:kworker.0 00000100:00100000:3.0:1784184995.530746:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184995.530746:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184995.530764:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784184995.530764:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784184995.530770:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265499264:0@lo:400:kworker.0 00000100:00100000:0.0:1784184995.530770:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265499136:0@lo:400:kworker.0 00000100:00100000:0.0:1784184995.530796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184995.530798:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184995.530817:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265499648:0@lo:400:kworker.0 00000100:00100000:3.0:1784184995.530829:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265499392 00000100:00100000:0.0:1784184995.530837:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784184995.530847:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265499392 00000100:00100000:0.0:1784184995.530873:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265499136 00000100:00100000:0.0:1784184995.530876:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265499136 00000100:00100000:3.0:1784184995.530895:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265499264 00000100:00100000:3.0:1784184995.530897:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265499264 00000100:00100000:0.0:1784184995.530901:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784184995.530908:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265499648 00000100:00100000:0.0:1784184995.530908:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265499136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184995.530910:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265499648 00000100:00100000:3.0:1784184995.530936:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784184995.530941:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265499392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184995.530953:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265499136:12345-0@lo:400:kworker.0 Request processed in 46us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184995.530961:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1784184995.530972:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265499392:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184995.530978:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784184995.530990:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784184995.530996:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265499264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784184995.531013:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265499136:0@lo:400:kworker.0 00000100:00100000:3.0:1784184995.531017:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265499264:12345-0@lo:400:kworker.0 Request processed in 23us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184995.531023:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784184995.531046:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784184995.531052:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265499648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784184995.531091:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265499648:12345-0@lo:400:kworker.0 Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184995.531096:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1784184995.531112:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784184995.531134:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265499264:0@lo:400:kworker.0 00000100:00100000:0.0:1784184995.531134:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265499648:0@lo:400:kworker.0 00000100:00100000:3.0:1784184995.531142:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265499392:0@lo:400:kworker.0 00000100:00100000:1.0:1784184995.531742:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265499008 00000100:00100000:1.0:1784184995.531748:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265499008 00000100:00100000:1.0:1784184995.531826:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784184995.531840:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265499008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784184995.531867:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184995.531910:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265499008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184995.531926:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784184995.531945:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265499520 00000100:00100000:1.0:1784184995.531949:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265499520 00000100:00080000:3.0:1784184995.534435:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784184995.534452:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784184995.535439:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1784184995.535450:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fbf5ec380, transno 4294967312 00000100:00100000:0.0:1784184995.535486:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265499008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784184995.536156:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784184995.536170:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265499520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784184995.536255:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265499520:12345-0@lo:400:kworker.0 Request processed in 88us (5506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184995.536262:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784184995.536301:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265499520:0@lo:400:kworker.0 00000100:00100000:2.0:1784184995.742253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184995.752716:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239275520 00000100:00100000:3.0:1784184995.752731:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239275520 00000100:00100000:3.0:1784184995.752813:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00100000:3.0:1784184995.752824:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+14:11328:x1870853239275520:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784184995.752843:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184995.752867:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187024 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.752930:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.752944:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.752954:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.752968:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.752975:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.752982:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753260:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753269:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753299:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753306:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184995.753310:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753318:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753351:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:3.0:1784184995.753355:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184995.753359:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753365:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b091b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753377:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753383:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753389:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753394:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184995.753397:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753413:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753421:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b5f93b83500) 00010000:00010000:3.0:1784184995.753423:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184995.753426:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753431:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0922 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753465:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0914 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187024 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753475:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:3.0:1784184995.753477:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184995.753480:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187024 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184995.753490:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f200, rc 0) 00000100:00100000:3.0:1784184995.753554:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+14:11328:x1870853239275520:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 732us (11311us total) trans 0 rc 301/301 00000100:00100000:3.0:1784184995.753562:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00080000:3.0:1784184995.753593:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784184995.774531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184995.774577:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239275776 00000100:00100000:0.0:1784184995.774587:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239275776 00000100:00100000:0.0:1784184995.775077:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 140 00000100:00100000:0.0:1784184995.775091:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+14:11328:x1870853239275776:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:0.0:1784184995.775147:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184995.775173:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0292 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e5d expref: 14 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.775190:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:0.0:1784184995.775195:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184995.776934:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.776970:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 5 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.776980:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.777033:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 5 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.777051:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 5 pid: 5792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184995.777069:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265499776:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184995.777181:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184995.787051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184995.789539:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265499776:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184995.789583:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184995.789614:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239275904 00000100:00100000:0.0:1784184995.789620:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239275904 00010000:00010000:0.0:1784184995.789691:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 6 pid: 5792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184995.789723:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:0.0:1784184995.789731:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2355:x1870853239275904:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184995.789745:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184995.789758:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 6 pid: 5792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789770:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 6 pid: 5792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789789:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b08ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187016 expref: 6 pid: 5792 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789802:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:0.0:1784184995.789807:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789815:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789823:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789843:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184995.789900:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2355:x1870853239275904:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 169us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184995.789908:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00010000:00010000:0.0:1784184995.789934:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789942:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789965:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789983:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.789990:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784184995.790728:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1784184995.798049:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784184995.798071:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.798081:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.798087:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.798093:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184995.798097:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.798104:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.798120:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3b00) 00010000:00010000:0.0:1784184995.798123:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184995.798127:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.798134:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b0929 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784184995.798172:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b198c303 reply state 00000000858910d4 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184995.798182:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784184995.799398:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+15:11328:x1870853239275776:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 24300us (24864us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1784184995.799411:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 140 00010000:00010000:0.0:1784184995.811810:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.811828:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.811836:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.811843:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184995.811848:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.811856:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.811872:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b5f87fe3600) 00010000:00010000:0.0:1784184995.811876:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184995.811880:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.811886:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0930 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184995.892605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184995.892730:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239276032 00000100:00100000:0.0:1784184995.892740:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239276032 00000100:00100000:0.0:1784184995.892801:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:0.0:1784184995.892811:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+14:11336:x1870853239276032:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:0.0:1784184995.892835:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184995.892857:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818702b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.892930:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b093e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.892944:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b093e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.892958:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b093e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184995.893031:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784184995.893035:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184995.893060:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b093e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.893081:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818702b expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.893098:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b093e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818702b expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.893106:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:0.0:1784184995.893122:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784184995.893125:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d600, rc 0) 00000100:00100000:0.0:1784184995.893196:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+15:11336:x1870853239276032:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 385us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184995.893203:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:0.0:1784184995.971403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184995.971557:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239276160 00000100:00100000:2.0:1784184995.971567:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239276160 00000100:00100000:2.0:1784184995.971637:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:2.0:1784184995.971648:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+15:11342:x1870853239276160:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784184995.971670:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184995.971692:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187032 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971758:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971772:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971783:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971800:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971806:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971812:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971927:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b095a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971953:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b095a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.971961:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b095a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184995.971997:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1784184995.972001:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184995.972059:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b095a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972071:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972077:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972084:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972089:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184995.972094:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972101:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972113:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:2.0:1784184995.972116:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184995.972121:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972137:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b094c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972152:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972158:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972163:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972168:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184995.972171:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972177:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972185:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b5f988b7c00) 00010000:00010000:2.0:1784184995.972188:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184995.972190:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972196:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0953 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972226:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187032 expref: 17 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972242:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b095a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187032 expref: 16 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.972255:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784184995.972258:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784184995.972260:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158dc00, rc 0) 00000100:00100000:2.0:1784184995.972648:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+16:11342:x1870853239276160:12345-192.168.201.29@tcp:101:bash.0 Request processed in 683us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184995.972658:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:1.0:1784184995.976240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184995.976427:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239276416 00000100:00100000:0.0:1784184995.976493:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239276416 00000100:00100000:0.0:1784184995.976577:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 143 00000100:00100000:0.0:1784184995.976585:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+16:11342:x1870853239276416:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784184995.976603:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184995.976621:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0961 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187039 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.976771:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.976785:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.976796:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.976848:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.976856:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.976862:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784184995.978256:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1784184995.979114:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979129:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979137:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979167:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979172:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979176:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979180:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184995.979183:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979187:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979195:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184995.979197:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184995.979200:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979219:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0968 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784184995.979230:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f7b2f8f reply state 0000000066e7ed19 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184995.979237:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784184995.979268:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0961 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979280:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.979288:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184995.979290:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184995.979292:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ce00, rc 0) 00000100:00100000:0.0:1784184995.979433:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+19:11342:x1870853239276416:12345-192.168.201.29@tcp:101:bash.0 Request processed in 2847us (3201us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1784184995.979664:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 143 00010000:00010000:2.0:1784184995.984901:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.984919:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.984927:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.984933:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184995.984938:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.984945:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.984964:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f87fe3b00) 00010000:00010000:2.0:1784184995.984967:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184995.984972:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184995.984978:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b096f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184995.986173:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184995.987403:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239276544 00000100:00100000:0.0:1784184995.987414:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239276544 00000100:00100000:0.0:1784184995.987492:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1784184995.987499:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239276544:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784184995.987514:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184995.987531:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187040 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784184995.987565:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784184995.987584:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1784184995.987587:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184995.987594:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.987607:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184995.987616:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784184995.987856:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239276544:12345-192.168.201.29@tcp:101:bash.0 Request processed in 355us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184995.987863:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00080000:3.0:1784184995.990408:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784184996.009326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184996.009443:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239276672 00000100:00100000:2.0:1784184996.009454:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239276672 00000100:00100000:2.0:1784184996.009508:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1784184996.009518:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+6:11342:x1870853239276672:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784184996.009538:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784184996.009556:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187047 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184996.009589:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184996.009596:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184996.009600:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784184996.009604:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184996.009772:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184996.009784:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 7 pid: 6588 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184996.009796:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1870853265499904:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784184996.009880:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f873529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184996.018452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184996.019005:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239276800 00000100:00100000:3.0:1784184996.019038:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239276800 00010000:00010000:3.0:1784184996.019079:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 8 pid: 6588 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184996.019128:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:3.0:1784184996.019137:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239276800:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184996.019152:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184996.019178:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 8 pid: 6588 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184996.019191:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 8 pid: 6588 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184996.019217:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784184996.019221:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784184996.019230:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184996.019240:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184996.019275:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184996.019287:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5778:1870853265500032:192.168.201.29@tcp:105: 00000100:00100000:3.0:1784184996.019389:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf000 going to sleep for 11 seconds 00010000:00010000:2.0:1784184996.019783:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2bbdd9/0x63160f6fbe8b0984 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187040 expref: 8 pid: 6588 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184996.019808:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1870853265499904:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184996.019832:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184996.019843:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c000, rc 0) 00000100:00100000:2.0:1784184996.019891:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:11342:x1870853239276672:12345-192.168.201.29@tcp:101:bash.0 Request processed in 10374us (10577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184996.019899:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1784184996.030412:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5778:1870853265500032:192.168.201.29@tcp:105: 00010000:00010000:3.0:1784184996.030443:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184996.030507:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239276800:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 11371us (12064us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184996.030519:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1784184996.035041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184996.035147:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239277056 00000100:00100000:3.0:1784184996.035160:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239277056 00000100:00100000:3.0:1784184996.035256:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1784184996.035268:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11342:x1870853239277056:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:3.0:1784184996.035725:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+19:11342:x1870853239277056:12345-192.168.201.29@tcp:35:bash.0 Request processed in 458us (692us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1784184996.035734:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000001:00080000:1.0:1784184996.166856:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000001:00080000:1.0:1784184996.169225:0:11824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:1.0:1784184996.189870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.190001:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239277312 00000100:00100000:0.0:1784184996.190011:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239277312 00000100:00100000:0.0:1784184996.190103:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:0.0:1784184996.190114:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+15:11352:x1870853239277312:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184996.190141:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184996.190164:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818704e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184996.190502:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1784184996.190791:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0992 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818704e expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.190819:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:0.0:1784184996.190822:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784184996.190827:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818704e expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.190840:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ca00, rc 0) 00000100:00100000:0.0:1784184996.190913:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:11352:x1870853239277312:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 801us (1053us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1784184996.190921:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:2.0:1784184996.196589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184996.196808:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239277568 00000100:00100000:1.0:1784184996.196819:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239277568 00000100:00100000:1.0:1784184996.196877:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1784184996.196888:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+16:11352:x1870853239277568:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184996.197403:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+17:11352:x1870853239277568:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 515us (822us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1784184996.197411:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1784184996.346217:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.346462:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239277696 00000100:00100000:0.0:1784184996.346473:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239277696 00000100:00100000:0.0:1784184996.346544:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:0.0:1784184996.346555:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+17:11358:x1870853239277696:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184996.346579:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184996.346602:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b09a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187055 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.346682:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b09a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.346697:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b09a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.346709:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b09a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184996.346925:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784184996.346935:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184996.347046:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b09a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.347077:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b09a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187055 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.347095:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b09a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187055 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.347102:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184996.347105:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784184996.347108:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d400, rc 0) 00000100:00100000:0.0:1784184996.347179:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11358:x1870853239277696:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 625us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184996.347186:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:2.0:1784184996.353443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.353537:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239277952 00000100:00100000:0.0:1784184996.353545:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239277952 00000100:00100000:0.0:1784184996.353599:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 146 00000100:00100000:0.0:1784184996.353609:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11358:x1870853239277952:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184996.353636:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184996.353661:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b09ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818705c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.353773:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b09b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.353786:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b09b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.353807:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b09b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184996.353819:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784184996.353956:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b09ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818705c expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.354108:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b09b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818705c expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.354116:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184996.354119:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184996.354122:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d200, rc 0) 00000100:00100000:0.0:1784184996.354191:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:11358:x1870853239277952:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 582us (755us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1784184996.354198:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 146 00010000:00010000:0.0:1784184996.362860:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184996.364243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.364653:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239278208 00000100:00100000:0.0:1784184996.364665:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239278208 00000100:00100000:0.0:1784184996.364735:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:0.0:1784184996.364745:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+20:11358:x1870853239278208:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184996.364770:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184996.364791:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b09c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187063 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.364914:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.366736:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.366752:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184996.366774:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:2.0:1784184996.368483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184996.368752:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239278336 00000100:00100000:3.0:1784184996.368762:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239278336 00000100:00100000:3.0:1784184996.368831:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1784184996.368842:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+24:2354:x1870853239278336:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184996.368858:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184996.368936:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b09c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187063 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184996.377241:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b09b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818705c expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184996.377270:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:3.0:1784184996.377276:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184996.377374:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2354:x1870853239278336:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 8533us (8898us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184996.377385:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00010000:00010000:0.0:1784184996.384454:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187063 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.384475:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184996.384478:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784184996.384483:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784184996.384655:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+21:11358:x1870853239278208:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 19909us (20418us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1784184996.384665:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:2.0:1784184996.401974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.402082:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239278464 00000100:00100000:0.0:1784184996.402091:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239278464 00000100:00100000:0.0:1784184996.402152:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1784184996.402162:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239278464:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:0.0:1784184996.402207:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.402231:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.402255:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784184996.402259:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784184996.402265:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.402303:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.402317:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 6 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184996.402396:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1870853265500160:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184996.402481:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784184996.410694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184996.410979:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239278592 00000100:00100000:1.0:1784184996.410990:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239278592 00002000:00100000:1.0:1784184996.411058:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b5fbfbced80 x1870853239278592/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:717/0 lens 504/0 e 0 to 0 dl 1784185007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784184996.411069:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fbfbced80 with x1870853239278592 ext(0->12) 00010000:00010000:1.0:1784184996.411079:0:6596:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 7 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.411097:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 7 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784184996.411105:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5fbfbced80 00000100:00100000:1.0:1784184996.411144:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1784184996.411155:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239278592:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:0.0:1784184996.411758:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1870853265500160:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184996.411800:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184996.411976:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239278592:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 821us (1291us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784184996.411985:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00002000:00100000:1.0:1784184996.411995:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b5fbfbced80 x1870853239278592/t4294967305(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:717/0 lens 504/448 e 0 to 0 dl 1784185007 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784184996.412004:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fbfbced80 with x1870853239278592 ext(0->12) 00010000:00010000:1.0:1784184996.412022:0:6596:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 9 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.412034:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 9 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784184996.412042:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5fbfbced80 00000100:00100000:1.0:1784184996.417018:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.417125:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239278720 00000100:00100000:0.0:1784184996.417134:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239278720 00010000:00010000:0.0:1784184996.417177:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 9 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184996.417222:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:0.0:1784184996.417231:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239278720:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184996.417261:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784184996.417284:0:5779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784184996.417287:0:5779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784184995 00002000:00010000:0.0:1784184996.417289:0:5779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784184996 00002000:00010000:0.0:1784184996.417291:0:5779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784184995 00010000:00010000:0.0:1784184996.417298:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 9 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.417311:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 9 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.417374:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b098b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187047 expref: 9 pid: 6590 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.417390:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784184996.417394:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784184996.417400:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.417409:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.417438:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184996.417604:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239278720:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 372us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184996.417613:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00010000:00010000:1.0:1784184996.417761:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417771:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417796:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417805:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417825:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417833:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784184996.417837:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417846:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417857:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.417865:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b09d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184996.417914:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239278464:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 15753us (15949us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184996.417922:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1784184996.422040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184996.422124:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239278976 00000100:00100000:1.0:1784184996.422136:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239278976 00000100:00100000:1.0:1784184996.422196:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:1.0:1784184996.422207:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+21:11358:x1870853239278976:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:1.0:1784184996.422269:0:5795:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187063 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784184996.422609:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1784184996.422678:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1784184996.423324:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1784184996.423415:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.423433:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.423442:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.423481:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184996.423497:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 25 pid: 5794 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184996.423512:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1870853265500288:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784184996.423599:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1784184996.429564:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1870853265500288:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784184996.429602:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184996.433411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184996.433460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184996.433486:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.433595:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239279104 00000100:00100000:0.0:1784184996.433607:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239279104 00010000:00010000:0.0:1784184996.433656:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 26 pid: 5794 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184996.433701:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:0.0:1784184996.433711:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f91f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+26:2356:x1870853239279104:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184996.433727:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184996.433734:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 26 pid: 5794 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.433748:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 26 pid: 5794 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.433771:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187039 expref: 26 pid: 5794 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.433787:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184996.433792:0:7492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.433801:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.433808:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.433834:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184996.433886:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f91f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+25:2356:x1870853239279104:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 176us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184996.433907:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00010000:00010000:0.0:1784184996.433973:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.433982:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784184996.434114:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1784184996.434315:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1784184996.434462:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265500416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784184996.434511:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184996.434555:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1540 going to sleep for 11 seconds 00000100:00100000:2.0:1784184996.434803:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239279232 00000100:00100000:2.0:1784184996.434810:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239279232 00000100:00100000:2.0:1784184996.434853:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 301 00000100:00100000:2.0:1784184996.434862:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239279232:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784184996.434907:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239279232:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 45us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184996.434914:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 301 00000100:00100000:2.0:1784184996.434945:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265500416 00000100:00100000:2.0:1784184996.434949:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265500416 00000100:00100000:2.0:1784184996.434977:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784184996.434993:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1870853265500416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784184996.435074:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1870853265500416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184996.435080:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784184996.435813:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265500416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784184996.436399:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1784184996.436475:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265500544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784184996.436524:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784184996.436547:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f91f1c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784184996.436650:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239279360 00000100:00100000:1.0:1784184996.436656:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239279360 00000100:00100000:1.0:1784184996.436733:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:1.0:1784184996.436742:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239279360:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784184996.436800:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239279360:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 59us (3399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184996.436808:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1784184996.437075:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265500544 00000100:00100000:2.0:1784184996.437080:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265500544 00000100:00100000:2.0:1784184996.437119:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784184996.437126:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1870853265500544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784184996.437289:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1870853265500544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 163us (764us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784184996.437295:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784184996.438885:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f85ee1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1870853265500544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784184996.438992:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1784184996.439068:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.439080:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.439087:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.439108:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184996.439112:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.439119:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.439134:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184996.439137:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784184996.439141:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.439147:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b09df lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784184996.439422:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784184996.439559:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1784184996.439570:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394605237607ns, next at 395605235317ns, rc = 0 00000001:00080000:0.0:1784184996.439577:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1784184996.439617:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184996.439620:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784184996.439628:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187063 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184996.439746:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+28:11358:x1870853239278976:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 17541us (17715us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1784184996.439755:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000020:00080000:0.0:1784184996.439761:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1784184996.440607:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784184996.447644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.447726:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239279488 00000100:00100000:0.0:1784184996.447737:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239279488 00000100:00100000:0.0:1784184996.447798:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 148 00000100:00100000:0.0:1784184996.447808:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+28:11358:x1870853239279488:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184996.447835:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184996.447860:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b09e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818706a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.447916:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b09e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818706a expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.447931:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b09e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818706a expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.447962:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184996.447965:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784184996.447969:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ce00, rc 0) 00000100:00100000:0.0:1784184996.448065:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+29:11358:x1870853239279488:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 258us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184996.448071:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 148 00000100:00100000:2.0:1784184996.454308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184996.454445:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239279744 00000100:00100000:3.0:1784184996.454455:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239279744 00000100:00100000:3.0:1784184996.454604:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1784184996.454615:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:11358:x1870853239279744:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1784184996.455082:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+30:11358:x1870853239279744:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 467us (782us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1784184996.455090:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1784184996.554151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.554789:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239280000 00000100:00100000:0.0:1784184996.554799:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239280000 00000100:00100000:0.0:1784184996.554861:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:0.0:1784184996.554869:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+30:11368:x1870853239280000:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184996.554889:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184996.554908:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187071 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184996.555170:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1784184996.555388:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187071 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.555403:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:0.0:1784184996.555407:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784184996.555412:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187071 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.555424:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784184996.555740:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+31:11368:x1870853239280000:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 871us (1600us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1784184996.555746:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:2.0:1784184996.562967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.563066:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239280128 00000100:00100000:0.0:1784184996.563078:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239280128 00000100:00100000:0.0:1784184996.563146:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 150 00000100:00100000:0.0:1784184996.563156:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:11368:x1870853239280128:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:0.0:1784184996.563248:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563265:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563289:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563306:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563369:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563378:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563720:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563729:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563736:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784184996.563779:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563792:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563798:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563805:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563810:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184996.563814:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563951:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563970:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184996.563973:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184996.563978:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563984:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b09fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.563996:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564001:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564015:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564020:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184996.564022:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564027:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564033:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184996.564035:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184996.564038:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564043:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564065:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564071:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564076:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564080:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184996.564082:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564087:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564093:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184996.564095:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184996.564098:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.564103:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184996.564248:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:11368:x1870853239280128:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1090us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184996.564256:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 150 00000100:00100000:3.0:1784184996.574996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.575069:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239280384 00000100:00100000:0.0:1784184996.575080:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239280384 00000100:00100000:0.0:1784184996.575141:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:0.0:1784184996.575163:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:11368:x1870853239280384:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184996.576488:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11368:x1870853239280384:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 1320us (1507us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1784184996.576500:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1784184996.638494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.638610:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239280640 00000100:00100000:0.0:1784184996.638620:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239280640 00000100:00100000:0.0:1784184996.638694:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:0.0:1784184996.638705:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11371:x1870853239280640:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184996.638729:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184996.638751:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187078 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.638826:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.638842:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.638853:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.638868:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.638875:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.638881:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639245:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639255:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639269:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184996.639280:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784184996.639431:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639438:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639444:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639449:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184996.639454:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639460:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639472:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184996.639475:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184996.639479:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639484:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639495:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639500:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639512:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639517:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184996.639520:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639525:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639533:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184996.639536:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184996.639538:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639544:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639584:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639597:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.639604:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184996.639606:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184996.639609:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631cc00, rc 0) 00000100:00100000:0.0:1784184996.639681:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11371:x1870853239280640:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 977us (1195us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1784184996.639698:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:2.0:1784184996.650831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184996.650934:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239280768 00000100:00100000:0.0:1784184996.650945:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239280768 00000100:00100000:0.0:1784184996.651003:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00100000:0.0:1784184996.651023:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11371:x1870853239280768:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1784184996.651091:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651108:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651120:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651149:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651155:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651162:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651168:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184996.651172:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651179:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651190:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184996.651208:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784184996.651212:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184996.651219:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184996.651309:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11371:x1870853239280768:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 288us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184996.651317:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00100000:2.0:1784184996.654601:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184996.654714:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239281024 00000100:00100000:1.0:1784184996.654724:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239281024 00000100:00100000:1.0:1784184996.654785:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1784184996.654795:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11371:x1870853239281024:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184996.655055:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+35:11371:x1870853239281024:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 260us (464us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1784184996.655063:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:2.0:1784184997.069581:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265500672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784184997.069667:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784184997.069850:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265500672 00000100:00100000:1.0:1784184997.069859:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265500672 00000100:00100000:1.0:1784184997.069916:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784184997.069927:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265500672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784184997.069953:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784184997.069994:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265500672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184997.070011:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784184997.070141:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265500672:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784184997.070235:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784184997.088317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184997.088460:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239281280 00000100:00100000:0.0:1784184997.088470:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239281280 00000100:00100000:0.0:1784184997.088637:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00100000:0.0:1784184997.088650:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+35:11402:x1870853239281280:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1784184997.088674:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184997.088697:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818707f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.088792:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.088807:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.088821:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184997.088832:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784184997.088961:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818707f expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.089012:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818707f expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.089021:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184997.089023:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184997.089027:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784184997.089095:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11402:x1870853239281280:12345-192.168.201.29@tcp:101:cat.0 Request processed in 447us (786us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1784184997.089103:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00080000:3.0:1784184997.089150:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784184997.094541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184997.094588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184997.094715:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239281408 00000100:00100000:3.0:1784184997.094726:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239281408 00000100:00100000:3.0:1784184997.094794:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1784184997.094805:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+37:2355:x1870853239281408:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184997.094822:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184997.094848:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818707f expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.094866:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:3.0:1784184997.094882:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184997.094937:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+36:2355:x1870853239281408:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 134us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184997.094944:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1784184997.099314:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239281664 00000100:00100000:1.0:1784184997.099329:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239281664 00000100:00100000:1.0:1784184997.099417:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:1.0:1784184997.099427:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+36:11402:x1870853239281664:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:1.0:1784184997.099744:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11402:x1870853239281664:12345-192.168.201.29@tcp:35:cat.0 Request processed in 317us (5154us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1784184997.099752:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1784184997.157314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184997.157425:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239281920 00000100:00100000:0.0:1784184997.157434:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239281920 00000100:00100000:0.0:1784184997.157481:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:0.0:1784184997.157488:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11408:x1870853239281920:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:0.0:1784184997.157508:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184997.157510:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784184997.157531:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b09a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187055 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.157546:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184997.157549:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784184997.157559:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187086 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.157738:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.157762:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.157768:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.157793:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.157802:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 37 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184997.157820:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265500800:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184997.157950:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1780 going to sleep for 11 seconds 00000100:00100000:2.0:1784184997.167032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184997.167323:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265500800:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784184997.167388:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184997.171209:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239282048 00000100:00100000:1.0:1784184997.171228:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239282048 00010000:00010000:1.0:1784184997.171296:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 38 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184997.171558:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:1.0:1784184997.171570:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+38:2356:x1870853239282048:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784184997.171588:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784184997.171596:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 38 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184997.171610:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 38 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184997.171646:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187078 expref: 38 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184997.171664:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:1.0:1784184997.171669:0:7492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184997.171678:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184997.171685:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184997.171725:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784184997.171781:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+37:2356:x1870853239282048:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 213us (4757us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184997.171789:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00010000:00010000:0.0:1784184997.171870:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.171879:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184997.171898:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784184997.172067:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 38 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.172097:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 37 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.172102:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184997.172104:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784184997.172106:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ca00, rc 0) 00000100:00100000:0.0:1784184997.172142:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11408:x1870853239281920:12345-192.168.201.29@tcp:101:dd.0 Request processed in 14653us (14835us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1784184997.172149:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:2.0:1784184997.176276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184997.176363:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239282304 00000100:00100000:3.0:1784184997.176373:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239282304 00000100:00100000:3.0:1784184997.176560:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 155 00000100:00100000:3.0:1784184997.176569:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11408:x1870853239282304:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:3.0:1784184997.176910:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.176928:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.176941:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784184997.177007:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1784184997.177034:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5da8ffc reply state 000000001cab04cf transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184997.177043:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784184997.177125:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+40:11408:x1870853239282304:12345-192.168.201.29@tcp:36:dd.0 Request processed in 557us (858us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1784184997.177130:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 155 00000020:00080000:3.0:1784184997.177134:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784184997.183229:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.183249:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.183270:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.183277:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184997.183283:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.183291:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.183310:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184997.183314:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184997.183318:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.183565:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0a64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184997.386683:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784184997.707742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184997.708108:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239282432 00000100:00100000:0.0:1784184997.708118:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239282432 00000100:00100000:0.0:1784184997.708189:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:0.0:1784184997.708200:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+39:11422:x1870853239282432:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:0.0:1784184997.708225:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184997.708297:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818708d expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.709018:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.709038:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.709087:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.709106:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.709114:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.709120:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.710242:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.710259:0:7503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.710269:0:7503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.710312:0:7503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.710717:0:7503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 40 pid: 5792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184997.710735:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265500928:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184997.710914:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784184997.742083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184997.742210:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239282688 00000100:00100000:1.0:1784184997.742219:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239282688 00000100:00100000:1.0:1784184997.742271:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1784184997.742280:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+41:5570:x1870853239282688:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784184997.743469:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+42:5570:x1870853239282688:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 1181us (1388us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1784184997.743481:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1784184997.744232:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265500928:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784184997.744260:0:7503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184997.755590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184997.755787:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239282816 00000100:00100000:3.0:1784184997.755797:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239282816 00010000:00010000:3.0:1784184997.755856:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 42 pid: 5792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184997.755902:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:3.0:1784184997.755912:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+42:2355:x1870853239282816:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184997.755928:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184997.755935:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 42 pid: 5792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.755949:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 42 pid: 5792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.755970:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187086 expref: 42 pid: 5792 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.755986:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:3.0:1784184997.756023:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.756033:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.756041:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.756093:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184997.756154:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+41:2355:x1870853239282816:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 243us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184997.756161:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00010000:00010000:2.0:1784184997.756370:0:7503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756379:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184997.756427:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784184997.756432:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184997.756459:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756472:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756482:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756489:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756496:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756502:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184997.756506:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756513:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756523:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784184997.756525:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184997.756537:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756543:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0a72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756555:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756561:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756567:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756572:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184997.756575:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756580:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756588:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f93b83700) 00010000:00010000:2.0:1784184997.756590:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184997.756593:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.756599:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.758575:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818708d expref: 41 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.758736:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818708d expref: 40 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.758745:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:2.0:1784184997.758748:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184997.758751:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e600, rc 0) 00000100:00100000:2.0:1784184997.758923:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+40:11422:x1870853239282432:12345-192.168.201.29@tcp:101:stat.0 Request processed in 50723us (51189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184997.758932:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:2.0:1784184997.878882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184997.878974:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239283072 00000100:00100000:3.0:1784184997.879018:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239283072 00000100:00100000:3.0:1784184997.879084:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 157 00000100:00100000:3.0:1784184997.879095:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+40:11429:x1870853239283072:12345-192.168.201.29@tcp:36:truncate.0 00010000:00010000:3.0:1784184997.879152:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184997.879181:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818708d expref: 40 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.879202:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:3.0:1784184997.879207:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784184997.879480:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.879493:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184997.879503:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784184997.879569:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1784184997.879592:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000f80cc0 reply state 00000000438ee2c3 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184997.879600:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784184997.879709:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+42:11429:x1870853239283072:12345-192.168.201.29@tcp:36:truncate.0 Request processed in 615us (838us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1784184997.879717:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 157 00000020:00080000:3.0:1784184997.879722:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784184997.883383:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.883403:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.883412:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.883418:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184997.883424:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.883432:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.883448:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:2.0:1784184997.883451:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184997.883470:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184997.883476:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0a87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784184998.026619:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784184998.026629:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784184998.026866:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1784184998.026875:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784184998.153910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184998.154046:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239283200 00000100:00100000:0.0:1784184998.154056:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239283200 00000100:00100000:0.0:1784184998.154142:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 158 00000100:00100000:0.0:1784184998.154153:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+41:11443:x1870853239283200:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:0.0:1784184998.154177:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184998.154201:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0a8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187094 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.154513:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.154529:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.154541:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.154567:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.154575:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.154583:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159189:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159211:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159225:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184998.159444:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1784184998.159449:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184998.159472:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159486:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159496:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159501:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159520:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159526:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631dc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184998.159530:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159538:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159551:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184998.159554:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184998.159558:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159565:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0a95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159578:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159585:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159591:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159806:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184998.159810:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159830:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159839:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184998.159841:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184998.159844:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159850:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0a9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159890:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0a8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159905:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.159913:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184998.159915:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784184998.159917:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631cc00, rc 0) 00000100:00100000:0.0:1784184998.160057:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+42:11443:x1870853239283200:12345-192.168.201.29@tcp:101:stat.0 Request processed in 5904us (6157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184998.160066:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 158 00000100:00100000:3.0:1784184998.272187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184998.272362:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239283456 00000100:00100000:1.0:1784184998.272372:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239283456 00000100:00100000:1.0:1784184998.272437:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00100000:1.0:1784184998.272447:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+42:11453:x1870853239283456:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784184998.272466:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784184998.272488:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0aaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818709b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784184998.272745:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1784184998.272894:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0aaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818709b expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184998.272921:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:1.0:1784184998.272924:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784184998.272929:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818709b expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184998.272941:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9e00, rc 0) 00000100:00100000:1.0:1784184998.273009:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+43:11453:x1870853239283456:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 564us (845us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1784184998.273016:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00100000:2.0:1784184998.277451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184998.277542:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239283712 00000100:00100000:1.0:1784184998.277552:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239283712 00000100:00100000:1.0:1784184998.277619:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1784184998.277637:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+43:11453:x1870853239283712:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784184998.278074:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+44:11453:x1870853239283712:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 446us (630us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1784184998.278082:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1784184998.395086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184998.395180:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239283968 00000100:00100000:3.0:1784184998.395192:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239283968 00000100:00100000:3.0:1784184998.395260:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:3.0:1784184998.395271:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+44:11459:x1870853239283968:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784184998.395296:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184998.395320:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0ab8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870a2 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.395460:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.395475:0:7503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 45 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.395484:0:7503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.395522:0:7503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 45 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.395535:0:7503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 45 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184998.395549:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc12d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265501056:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784184998.396300:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf300 going to sleep for 11 seconds 00000100:00100000:3.0:1784184998.400285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184998.400406:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239284096 00000100:00100000:0.0:1784184998.400416:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239284096 00010000:00010000:0.0:1784184998.400460:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 46 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184998.400525:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:0.0:1784184998.400535:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+46:2356:x1870853239284096:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184998.400551:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184998.400558:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 46 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.400570:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 46 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.400594:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184998.400609:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.400618:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.400795:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.400818:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184998.400880:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+46:2356:x1870853239284096:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 346us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184998.400889:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00010000:00010000:2.0:1784184998.401541:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0aa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187094 expref: 45 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184998.401558:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc12d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265501056:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184998.401583:0:7503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.401603:0:7503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.401609:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184998.401634:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1784184998.401793:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0ab8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 46 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.401811:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 45 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.401819:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:2.0:1784184998.401831:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784184998.401834:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ea00, rc 0) 00000100:00100000:2.0:1784184998.401884:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+45:11459:x1870853239283968:12345-192.168.201.29@tcp:101:bash.0 Request processed in 6614us (6806us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1784184998.401891:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:3.0:1784184998.406737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784184998.406849:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239284352 00000100:00100000:1.0:1784184998.406860:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239284352 00000100:00100000:1.0:1784184998.406925:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 161 00000100:00100000:1.0:1784184998.406936:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+45:11459:x1870853239284352:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:1.0:1784184998.407227:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184998.407257:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784184998.407287:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784184998.407384:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1784184998.407412:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d870c6ef reply state 000000001ba6a0f7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784184998.407424:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784184998.407531:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+48:11459:x1870853239284352:12345-192.168.201.29@tcp:36:bash.0 Request processed in 595us (802us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1784184998.407538:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 161 00000020:00080000:1.0:1784184998.407543:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784184998.410428:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784184998.411702:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.411717:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.411742:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.411749:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184998.411754:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.411761:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.411776:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184998.411780:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184998.411783:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.411790:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0acd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184998.414855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184998.415455:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239284480 00000100:00100000:0.0:1784184998.415467:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239284480 00000100:00100000:0.0:1784184998.415535:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:0.0:1784184998.415546:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+47:11459:x1870853239284480:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784184998.415574:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184998.415608:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870a9 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.415694:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.415710:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 48 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.415733:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.415767:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 48 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.415780:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 48 pid: 7503 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784184998.415794:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265501184:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784184998.416124:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1480 going to sleep for 11 seconds 00000100:00100000:1.0:1784184998.425365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184998.425864:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239284608 00000100:00100000:3.0:1784184998.425875:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239284608 00010000:00010000:3.0:1784184998.425920:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 49 pid: 7503 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184998.425965:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1784184998.425987:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+49:2356:x1870853239284608:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784184998.426004:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784184998.426011:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 49 pid: 7503 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.426024:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 49 pid: 7503 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.426046:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:3.0:1784184998.426052:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.426061:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.426068:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.426087:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184998.426168:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+49:2356:x1870853239284608:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 193us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184998.426176:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00010000:00010000:2.0:1784184998.429752:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0abf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870a2 expref: 48 pid: 7503 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184998.429779:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265501184:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784184998.429832:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.429856:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.429862:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184998.429910:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784184998.429915:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784184998.429936:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.429969:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d400/0x63160f6fbe8b0ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870a9 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.429997:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870a9 expref: 47 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.430027:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:2.0:1784184998.430030:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184998.430034:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ca00, rc 0) 00000100:00100000:2.0:1784184998.430103:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+47:11459:x1870853239284480:12345-192.168.201.29@tcp:101:bash.0 Request processed in 14557us (15256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184998.430112:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:1.0:1784184998.436636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184998.436781:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239284864 00000100:00100000:3.0:1784184998.436802:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239284864 00000100:00100000:3.0:1784184998.436860:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:3.0:1784184998.436872:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+47:11459:x1870853239284864:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:3.0:1784184998.437098:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+48:11459:x1870853239284864:12345-192.168.201.29@tcp:35:bash.0 Request processed in 228us (469us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1784184998.437106:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1784184998.593119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184998.593476:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239285120 00000100:00100000:3.0:1784184998.593487:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239285120 00000100:00100000:3.0:1784184998.593558:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:3.0:1784184998.593567:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+48:11469:x1870853239285120:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784184998.593596:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184998.593616:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870b0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784184998.593919:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1784184998.594093:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ae2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870b0 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.594108:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:3.0:1784184998.594111:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784184998.594115:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870b0 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.594139:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ec00, rc 0) 00000100:00100000:3.0:1784184998.594201:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+49:11469:x1870853239285120:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 635us (1091us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1784184998.594208:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:1.0:1784184998.598154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184998.598244:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239285248 00000100:00100000:3.0:1784184998.598253:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239285248 00000100:00100000:3.0:1784184998.598313:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:3.0:1784184998.598324:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+49:11469:x1870853239285248:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1784184998.598432:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.598449:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.598461:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.598499:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.598507:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.598514:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599140:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599161:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599169:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784184998.599213:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599226:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599302:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599309:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599315:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184998.599319:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599326:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599475:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784184998.599479:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184998.599484:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599491:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0af0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599512:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599518:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599524:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599530:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184998.599533:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599538:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599547:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f93b83500) 00010000:00010000:3.0:1784184998.599549:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184998.599553:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599558:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599575:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599581:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599587:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599609:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784184998.599613:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599619:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.599628:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:3.0:1784184998.599631:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784184998.600616:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.600628:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0afe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784184998.601095:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+49:11469:x1870853239285248:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 2769us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184998.601105:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:1.0:1784184998.608097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184998.609384:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239285504 00000100:00100000:3.0:1784184998.609398:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239285504 00000100:00100000:3.0:1784184998.609467:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:3.0:1784184998.609477:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+49:11469:x1870853239285504:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1784184998.611093:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+50:11469:x1870853239285504:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 1607us (2995us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1784184998.611104:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:1.0:1784184998.695757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184998.695899:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239285760 00000100:00100000:3.0:1784184998.695910:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239285760 00000100:00100000:3.0:1784184998.696006:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:3.0:1784184998.696033:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+50:11472:x1870853239285760:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784184998.696063:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784184998.696087:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0b05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.696160:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.696175:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.696184:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.696195:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.696199:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184998.696203:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703740:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703761:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703774:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784184998.703800:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784184998.703905:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703914:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703921:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703927:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184998.703932:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703940:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703960:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784184998.703964:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184998.703968:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.703984:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0b0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704000:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704006:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704011:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704016:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184998.704018:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704024:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704032:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f93b83500) 00010000:00010000:2.0:1784184998.704034:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784184998.704037:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704042:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704115:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0b05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870b7 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704131:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870b7 expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.704140:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:2.0:1784184998.704142:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784184998.704145:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d000, rc 0) 00000100:00100000:2.0:1784184998.704244:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11472:x1870853239285760:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 8213us (8498us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1784184998.704254:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:1.0:1784184998.716189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784184998.716322:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239285888 00000100:00100000:2.0:1784184998.716365:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239285888 00000100:00100000:2.0:1784184998.716436:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:2.0:1784184998.716446:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11472:x1870853239285888:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1784184998.716514:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716531:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716542:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716570:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716599:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716605:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716611:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784184998.716616:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716624:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716647:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:2.0:1784184998.716651:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784184998.716655:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784184998.716662:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0b28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784184998.716743:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11472:x1870853239285888:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 298us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784184998.716751:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:1.0:1784184998.717369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184998.718007:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239286016 00000100:00100000:0.0:1784184998.718016:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239286016 00000100:00100000:0.0:1784184998.718078:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1784184998.718088:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+52:2355:x1870853239286016:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784184998.718102:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784184998.718123:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870b7 expref: 52 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.718137:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184998.718142:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784184998.718179:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+51:2355:x1870853239286016:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 93us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184998.718186:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1784184998.724118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184998.724210:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239286272 00000100:00100000:0.0:1784184998.724241:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239286272 00000100:00100000:0.0:1784184998.724299:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1784184998.724309:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+51:11472:x1870853239286272:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784184998.724554:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11472:x1870853239286272:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 245us (444us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1784184998.724561:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1784184998.973037:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184998.973146:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239286528 00000100:00100000:0.0:1784184998.973156:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239286528 00000100:00100000:0.0:1784184998.973220:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:0.0:1784184998.973239:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11490:x1870853239286528:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1784184998.973267:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184998.973289:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870be expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.973425:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.973441:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.973455:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184998.973467:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784184998.973621:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870be expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.973645:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870be expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184998.973671:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784184998.973674:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784184998.973678:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784184998.973743:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11490:x1870853239286528:12345-192.168.201.29@tcp:101:cat.0 Request processed in 514us (717us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1784184998.973750:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:2.0:1784184999.028215:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184999.028371:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239286656 00000100:00100000:0.0:1784184999.028391:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239286656 00000100:00100000:0.0:1784184999.028476:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:0.0:1784184999.028487:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11491:x1870853239286656:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184999.028513:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184999.028536:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870c5 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.028615:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.028644:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.028657:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184999.028872:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784184999.028877:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184999.028958:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.029012:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870c5 expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.029030:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870c5 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.029039:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184999.029042:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784184999.029046:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784184999.029118:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11491:x1870853239286656:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 632us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1784184999.029125:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00080000:3.0:1784184999.029510:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784184999.040662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184999.040872:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239287040 00000100:00100000:0.0:1784184999.040883:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239287040 00000100:00100000:0.0:1784184999.040944:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1784184999.040954:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11491:x1870853239287040:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784184999.041298:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11491:x1870853239287040:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 344us (647us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784184999.041307:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1784184999.047013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184999.047100:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239287168 00000100:00100000:3.0:1784184999.047113:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239287168 00000100:00100000:3.0:1784184999.047187:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1784184999.047196:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f91f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11491:x1870853239287168:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:3.0:1784184999.047213:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784184999.047245:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870a9 expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184999.047284:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870be expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184999.047295:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b09e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818706a expref: 54 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184999.047303:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f87fe3400) 00010000:00010000:3.0:1784184999.047546:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784184999.047618:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f91f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+53:11491:x1870853239287168:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 422us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184999.047634:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1784184999.051155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784184999.051247:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239287296 00000100:00100000:3.0:1784184999.051258:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239287296 00000100:00100000:3.0:1784184999.051356:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:3.0:1784184999.051369:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+53:11491:x1870853239287296:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:3.0:1784184999.051733:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184999.051751:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784184999.051764:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784184999.052022:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1784184999.052120:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+53:11491:x1870853239287296:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 752us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784184999.052145:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:1.0:1784184999.085935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784184999.086038:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239287424 00000100:00100000:0.0:1784184999.086047:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239287424 00000100:00100000:0.0:1784184999.086103:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:0.0:1784184999.086113:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+53:11493:x1870853239287424:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784184999.086135:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784184999.086158:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.086247:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.086262:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.086274:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.086290:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.086297:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.086539:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.086990:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087000:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087007:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784184999.087041:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784184999.087045:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784184999.087062:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087083:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087092:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087099:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087105:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087112:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184999.087116:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087123:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087136:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784184999.087138:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184999.087142:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087148:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0b60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087159:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087165:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087174:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087180:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784184999.087182:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087188:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087195:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784184999.087197:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784184999.087199:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087205:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0b67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087538:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087554:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 54 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784184999.087562:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f93b83a00) 00010000:00010000:0.0:1784184999.087564:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784184999.087567:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:1.0:1784184999.087917:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11493:x1870853239287424:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1803us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784184999.087935:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 170 00010000:00010000:3.0:1784184999.445528:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784185000.022013:0:12269:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784185000.022023:0:12269:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784185000.022074:0:12269:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784185000.022080:0:12269:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1784185000.075005:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784185000.075015:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784185000.075061:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784185000.075070:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784185000.075184:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f88b93100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265501312:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784185000.075285:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e812f4000 going to sleep for 11 seconds 00000100:00100000:3.0:1784185000.083158:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f88b93100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265501312:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784185000.089678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.089871:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239287552 00000100:00100000:0.0:1784185000.089882:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239287552 00000100:00100000:0.0:1784185000.089936:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:0.0:1784185000.089947:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11505:x1870853239287552:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784185000.089989:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784185000.090097:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11505:x1870853239287552:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 151us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.090106:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:3.0:1784185000.113939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185000.114028:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239287680 00000100:00100000:2.0:1784185000.114038:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239287680 00000100:00100000:2.0:1784185000.114103:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:2.0:1784185000.114114:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc12d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11505:x1870853239287680:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784185000.114205:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114222:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114236:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114302:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114310:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114317:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114367:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114377:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114394:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185000.114432:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784185000.114436:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185000.114447:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114457:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114469:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114475:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114480:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185000.114484:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114491:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114503:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:2.0:1784185000.114506:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185000.114511:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114516:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0b75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114528:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114533:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114539:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114544:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185000.114553:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114559:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114567:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b5f988b7700) 00010000:00010000:2.0:1784185000.114579:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185000.114583:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114589:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0b7c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114603:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114608:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114614:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114619:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185000.114622:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114628:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114635:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f93b83a00) 00010000:00010000:2.0:1784185000.114638:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185000.114647:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.114654:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.115098:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc12d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11505:x1870853239287680:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 984us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185000.115107:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:0.0:1784185000.121989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.122534:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239287936 00000100:00100000:3.0:1784185000.122547:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239287936 00000100:00100000:3.0:1784185000.122612:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:3.0:1784185000.122623:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11505:x1870853239287936:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185000.122644:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185000.122666:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0b8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870d3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122770:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122785:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122797:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185000.122809:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784185000.122904:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122912:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122918:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122933:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185000.122937:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122944:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122969:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f93b83a00) 00010000:00010000:3.0:1784185000.122972:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784185000.122977:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.122983:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.123022:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0b8a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870d3 expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.123033:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:3.0:1784185000.123035:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784185000.123039:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0b8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870d3 expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.123050:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e000, rc 0) 00000100:00100000:3.0:1784185000.123113:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11505:x1870853239287936:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 492us (1134us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1784185000.123120:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:1.0:1784185000.128960:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.129027:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239288064 00000100:00100000:3.0:1784185000.129045:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239288064 00000100:00100000:3.0:1784185000.129102:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00100000:3.0:1784185000.129112:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11505:x1870853239288064:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784185000.129144:0:5792:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784185000.129259:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11505:x1870853239288064:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 148us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.129267:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00100000:1.0:1784185000.137018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.137150:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239288320 00000100:00100000:0.0:1784185000.137161:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239288320 00000100:00100000:0.0:1784185000.137237:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:0.0:1784185000.137247:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f88b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11505:x1870853239288320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784185000.137266:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185000.137269:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784185000.137829:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870c5 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.137846:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784185000.137851:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784185000.137865:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870da expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784185000.139084:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1784185000.139375:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.139484:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.139497:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.139576:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0b9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870da expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.139594:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870da expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.139603:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:0.0:1784185000.139606:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784185000.139609:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ce00, rc 0) 00000100:00100000:0.0:1784185000.139689:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f88b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11505:x1870853239288320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2443us (2679us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1784185000.139699:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:1.0:1784185000.144812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.144894:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239288576 00000100:00100000:3.0:1784185000.144904:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239288576 00000100:00100000:3.0:1784185000.144973:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:3.0:1784185000.144982:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11505:x1870853239288576:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784185000.145045:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185000.145075:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b0ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870da expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145096:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3900) 00010000:00010000:3.0:1784185000.145108:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784185000.145133:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145148:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145158:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145173:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145196:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145204:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145523:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145532:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145538:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145545:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185000.145549:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145557:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145578:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784185000.145581:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185000.145585:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145591:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145602:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145616:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145622:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145627:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185000.145631:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145637:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145645:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd2bd36ff (ffff9b5f93b83d00) 00010000:00010000:3.0:1784185000.145648:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185000.145651:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.145657:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd2bd36ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185000.145736:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11505:x1870853239288576:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 754us (932us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784185000.145744:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:1.0:1784185000.151280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.151549:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239288704 00000100:00100000:0.0:1784185000.151559:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239288704 00000100:00100000:0.0:1784185000.151708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:0.0:1784185000.151718:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11505:x1870853239288704:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784185000.151739:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185000.151762:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0bc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870e1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.151799:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.151820:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.151832:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.151931:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631dc00/0x63160f6fbe8b0bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.151959:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.151968:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:0.0:1784185000.151971:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784185000.151974:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784185000.152105:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11505:x1870853239288704:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 388us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.152112:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:1.0:1784185000.158898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.158970:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239288960 00000100:00100000:3.0:1784185000.158980:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239288960 00000100:00100000:3.0:1784185000.159051:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00100000:3.0:1784185000.159062:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11505:x1870853239288960:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784185000.159177:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.159202:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.159215:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784185000.160049:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1784185000.160061:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398325728035ns, next at 399325725680ns, rc = 0 00000004:00010000:3.0:1784185000.160150:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd4f774d reply state 0000000055571ecd transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185000.160160:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784185000.160317:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+58:11505:x1870853239288960:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1255us (1425us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1784185000.160325:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 178 00010000:00010000:2.0:1784185000.163161:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.163180:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.163188:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.163194:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185000.163198:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.163217:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.163238:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:2.0:1784185000.163241:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784185000.163246:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.163251:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0bd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185000.165311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.165524:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239289088 00000100:00100000:3.0:1784185000.165534:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239289088 00000100:00100000:3.0:1784185000.165594:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 179 00000100:00100000:3.0:1784185000.165605:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+57:11505:x1870853239289088:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185000.165629:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185000.165650:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870e8 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.165714:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.165731:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.165772:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:3.0:1784185000.165776:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185000.165780:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e000, rc 0) 00000100:00100000:3.0:1784185000.165933:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+58:11505:x1870853239289088:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 330us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.165941:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 179 00000100:00100000:1.0:1784185000.173046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185000.173250:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239289216 00000100:00100000:2.0:1784185000.173260:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239289216 00000100:00100000:2.0:1784185000.173358:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1784185000.173377:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2355:x1870853239289216:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784185000.173521:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784185000.174032:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239289216:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 663us (993us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784185000.174041:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1784185000.178091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.178160:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239289472 00000100:00100000:3.0:1784185000.178171:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239289472 00000100:00100000:3.0:1784185000.178240:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1784185000.178250:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+58:11505:x1870853239289472:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784185000.178816:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11505:x1870853239289472:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 565us (730us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1784185000.178826:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1784185000.203854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.207684:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239289728 00000100:00100000:3.0:1784185000.207700:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239289728 00000100:00100000:2.0:1784185000.208979:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 180 00000100:00100000:2.0:1784185000.208994:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11505:x1870853239289728:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784185000.209125:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11505:x1870853239289728:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 134us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185000.209133:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 180 00000100:00100000:2.0:1784185000.213304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.213639:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239289856 00000100:00100000:3.0:1784185000.217104:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239289856 00000100:00100000:3.0:1784185000.217281:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 181 00000100:00100000:3.0:1784185000.217294:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11505:x1870853239289856:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185000.217315:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185000.217355:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870ef expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.217708:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.217738:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.217750:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185000.217785:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185000.217803:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.217827:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870ef expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.217845:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870ef expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.217855:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:3.0:1784185000.217858:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784185000.217861:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896fa00, rc 0) 00000100:00100000:3.0:1784185000.217931:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11505:x1870853239289856:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 640us (4637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.217939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 181 00000100:00100000:2.0:1784185000.225350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.225413:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239289984 00000100:00100000:0.0:1784185000.225423:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239289984 00000100:00100000:0.0:1784185000.225532:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1784185000.225546:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2353:x1870853239289984:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784185000.225577:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185000.225604:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870f6 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784185000.225648:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5880a7, blocks: 0x1 00010000:00010000:0.0:1784185000.225682:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1784185000.225687:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185000.225700:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.225720:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 8 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.225733:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631dc00, rc 0) 00000100:00100000:0.0:1784185000.225792:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239289984:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 249us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.225799:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1784185000.246883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.246929:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239290240 00000100:00100000:3.0:1784185000.246939:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239290240 00000100:00100000:3.0:1784185000.247009:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:3.0:1784185000.247020:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11505:x1870853239290240:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784185000.247134:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11505:x1870853239290240:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 115us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.247157:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:3.0:1784185000.260627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.264058:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239290368 00000100:00100000:0.0:1784185000.264075:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239290368 00000100:00100000:0.0:1784185000.264141:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:0.0:1784185000.264151:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:11505:x1870853239290368:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784185000.264170:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185000.264190:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381870fd expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.264223:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 9 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.264232:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185000.264237:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185000.264243:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 9 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.264290:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 9 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.264305:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 9 pid: 6589 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185000.264320:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6588:1870853265501440:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784185000.264451:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784185000.280592:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6588:1870853265501440:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784185000.281177:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 9 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.281204:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d200, rc 0) 00000100:00100000:0.0:1784185000.281279:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:11505:x1870853239290368:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 17127us (21197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.281288:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1784185000.288494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185000.288537:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239290496 00000100:00100000:1.0:1784185000.288546:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239290496 00010000:00010000:1.0:1784185000.288861:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 9 pid: 6589 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185000.288910:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:1.0:1784185000.288920:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239290496:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784185000.288943:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784185000.288976:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 9 pid: 6589 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.288991:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 9 pid: 6589 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.289015:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000367e758c/0x63160f6fbe8b0bec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870f6 expref: 9 pid: 6589 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.289029:0:7492:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185000.289033:0:7492:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185000.289042:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.289053:0:7492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.289090:0:7492:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185000.289106:0:7492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9341180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7492:1870853265501568:192.168.201.29@tcp:105: 00000100:00100000:1.0:1784185000.289191:0:7492:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e812f4540 going to sleep for 11 seconds 00000100:00100000:1.0:1784185000.301654:0:7492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9341180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7492:1870853265501568:192.168.201.29@tcp:105: 00010000:00010000:1.0:1784185000.301682:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784185000.301757:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239290496:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 12836us (13270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185000.301768:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:2.0:1784185000.304971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.305090:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239290624 00000100:00100000:3.0:1784185000.305100:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239290624 00002000:00100000:3.0:1784185000.305149:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b5f84467480 x1870853239290624/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:721/0 lens 504/0 e 0 to 0 dl 1784185011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784185000.305160:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f84467480 with x1870853239290624 ext(0->8) 00002000:00010000:3.0:1784185000.305165:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5f84467480 00000100:00100000:3.0:1784185000.305197:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1784185000.305206:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239290624:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784185000.305830:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2356:x1870853239290624:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 621us (865us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1784185000.305839:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00002000:00100000:3.0:1784185000.305846:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b5f84467480 x1870853239290624/t4294967314(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:721/0 lens 504/448 e 0 to 0 dl 1784185011 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784185000.305854:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f84467480 with x1870853239290624 ext(0->8) 00002000:00010000:3.0:1784185000.305858:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5f84467480 00000100:00100000:0.0:1784185000.308620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.310711:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239290752 00000100:00100000:3.0:1784185000.310725:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239290752 00000100:00100000:3.0:1784185000.310918:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 183 00000100:00100000:3.0:1784185000.310929:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11505:x1870853239290752:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784185000.394815:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1784185000.394845:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1784185000.394860:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5f88cd1540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1784185000.394865:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f82e25400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f88cd1900 00000020:00080000:2.0:1784185000.394868:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f82e25200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fbfaf7c00 00000001:00080000:2.0:1784185000.394921:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1784185000.394926:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1784185000.395080:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1784185000.395245:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1784185000.395319:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265501696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784185000.395428:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185000.395509:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265501824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1784185000.395535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185000.395571:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265501696 00000100:00100000:2.0:1784185000.395577:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265501696 00000100:00100000:2.0:1784185000.395629:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265501824 00000100:00100000:2.0:1784185000.395633:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265501824 00000100:00100000:2.0:1784185000.395658:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784185000.395666:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265501696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784185000.395695:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1784185000.395727:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5880a3, atime: 0x6a5880a4, ctime: 0x6a5880a3, blocks: 0x1 00010000:00010000:2.0:1784185000.395735:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.395751:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1784185000.395756:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185000.395762:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.395778:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.395788:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.395796:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.395825:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784185000.396291:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1870853265501696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 624us (861us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784185000.396299:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784185000.396318:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784185000.396325:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265501824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1784185000.396456:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784185000.396460:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784185000 00002000:00010000:2.0:1784185000.396463:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784185000.396465:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784184999 -> 1784185000 00002000:00010000:2.0:1784185000.396468:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784185000.396501:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1870853265501824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (964us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784185000.396507:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1784185000.396527:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784185000.396530:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784185000.396547:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185000.396553:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.396562:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185000.396567:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.396576:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.396602:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.396609:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073529bd4/0x63160f6fbe8b0bfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.396648:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185000.396650:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185000.396652:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784185000.396685:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5f84464380/2, rc 0, transno 4294967315 00000100:00100000:2.0:1784185000.396691:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265501824:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1784185000.396711:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5f84467b80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1784185000.396714:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265501696:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784185000.396935:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11505:x1870853239290752:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 86006us (88322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.396963:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 183 00000100:00100000:0.0:1784185000.402259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185000.402754:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239290880 00000100:00100000:2.0:1784185000.402766:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239290880 00000100:00100000:2.0:1784185000.402821:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1784185000.402831:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2354:x1870853239290880:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784185000.438139:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2354:x1870853239290880:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 35299us (35879us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.438155:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000001:00080000:3.0:1784185000.438242:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1784185000.438256:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1784185000.438262:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1784185000.442007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.442116:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239291136 00000100:00100000:3.0:1784185000.442126:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239291136 00000100:00100000:3.0:1784185000.442226:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 184 00000100:00100000:3.0:1784185000.442236:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11505:x1870853239291136:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784185000.442291:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185000.442320:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870ef expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.442487:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:3.0:1784185000.442493:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784185000.442524:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.442539:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.442550:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784185000.442792:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005aa7ee6c reply state 00000000f08dfb47 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185000.442802:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784185000.442962:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:11505:x1870853239291136:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 726us (962us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1784185000.442987:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 184 00010000:00010000:0.0:1784185000.444979:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.445012:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.445020:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.445026:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185000.445031:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.445038:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.445053:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:0.0:1784185000.445056:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185000.445059:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.445065:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.450673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.450762:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239291264 00000100:00100000:0.0:1784185000.450773:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239291264 00000100:00100000:0.0:1784185000.450830:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1784185000.450841:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239291264:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784185000.451130:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784185000.451134:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1784185000 -> 1784184998 00002000:00010000:0.0:1784185000.451137:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784184996 00002000:00010000:0.0:1784185000.451139:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784185000 -> 1784184998 00002000:00010000:0.0:1784185000.451156:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784185000.451226:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239291264:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 386us (562us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784185000.451234:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1784185000.454823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185000.455515:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239291520 00000100:00100000:2.0:1784185000.455526:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239291520 00000100:00100000:2.0:1784185000.455596:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 185 00000100:00100000:2.0:1784185000.455607:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11505:x1870853239291520:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784185000.455680:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.455711:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.455721:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.455759:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.455774:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 18 pid: 5794 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.455789:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265501952:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784185000.455895:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f882476c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784185000.459228:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185000.460813:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265501952:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185000.460843:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185000.465292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.465849:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239291648 00000100:00100000:3.0:1784185000.465860:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239291648 00010000:00010000:3.0:1784185000.465904:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 19 pid: 5794 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185000.466080:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:3.0:1784185000.466091:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+19:2355:x1870853239291648:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185000.466109:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185000.466117:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 19 pid: 5794 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.466131:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 19 pid: 5794 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.466155:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b0bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e1 expref: 19 pid: 5794 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.466171:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:3.0:1784185000.466177:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.466186:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.466194:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.466256:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185000.466615:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2355:x1870853239291648:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 523us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.466623:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00010000:00010000:2.0:1784185000.466966:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.466976:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.467006:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.467023:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.467029:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.467035:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185000.467039:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.467046:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.467055:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:2.0:1784185000.467058:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784185000.467061:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.467066:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.467126:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+17:11505:x1870853239291520:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 11520us (12312us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784185000.467134:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 185 00000100:00100000:1.0:1784185000.473786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.473887:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239291776 00000100:00100000:0.0:1784185000.473898:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239291776 00000100:00100000:0.0:1784185000.473971:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1784185000.473982:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239291776:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784185000.474028:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.474051:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.474059:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185000.474064:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185000.474069:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.474106:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.474121:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 8 pid: 6588 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185000.474136:0:10137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10137:1870853265502080:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784185000.474248:0:10137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f98273b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784185000.478543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.478672:0:10137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10137:1870853265502080:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784185000.478699:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185000.479713:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239291904 00000100:00100000:3.0:1784185000.479724:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239291904 00010000:00010000:2.0:1784185000.479873:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 9 pid: 6588 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.479970:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:2.0:1784185000.479981:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2356:x1870853239291904:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784185000.480011:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185000.480037:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 9 pid: 6588 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.480050:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 9 pid: 6588 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.480071:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d1d8863/0x63160f6fbe8b0bf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381870fd expref: 9 pid: 6588 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.480087:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784185000.480091:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784185000.480096:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.480105:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.480136:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185000.480192:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239291904:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 213us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185000.480207:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00010000:00010000:0.0:1784185000.481776:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481793:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481829:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481837:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481846:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481853:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185000.481857:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481866:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481904:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.481911:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686fcde4/0x63160f6fbe8b0c0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185000.482017:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239291776:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 8033us (8237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.482027:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1784185000.485841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.486248:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239292160 00000100:00100000:3.0:1784185000.486260:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239292160 00000100:00100000:2.0:1784185000.489621:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 186 00000100:00100000:2.0:1784185000.489639:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+17:11505:x1870853239292160:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784185000.489727:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.489759:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.489772:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.489989:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.490001:0:7503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.490010:0:7503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.490045:0:7503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.490060:0:7503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 18 pid: 5793 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.490074:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265502208:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784185000.490171:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f882476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784185000.495153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.495528:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239292288 00000100:00100000:0.0:1784185000.495538:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239292288 00010000:00010000:0.0:1784185000.495591:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 19 pid: 5793 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185000.495643:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:0.0:1784185000.495654:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+19:2356:x1870853239292288:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185000.495670:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185000.495678:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 19 pid: 5793 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.495692:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 19 pid: 5793 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.495714:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:0.0:1784185000.495720:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.495737:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.495744:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.495764:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185000.495825:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+19:2356:x1870853239292288:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 171us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.495833:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00010000:00010000:2.0:1784185000.497655:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870e8 expref: 18 pid: 5793 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.497683:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265502208:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185000.497710:0:7503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.497735:0:7503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.497740:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784185000.497922:0:7503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1784185000.498106:0:7503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1784185000.498153:0:7503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1784185000.500054:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7503:1870853265502336:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784185000.500182:0:7503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185000.500229:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7b540 going to sleep for 11 seconds 00000100:00100000:0.0:1784185000.500846:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265502336 00000100:00100000:0.0:1784185000.500856:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265502336 00000100:00100000:0.0:1784185000.500916:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784185000.500926:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7503:x1870853265502336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784185000.501027:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7503:x1870853265502336:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.501034:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784185000.501160:0:7503:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1784185000.501167:0:7503:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5f84464380, transno 4294967315 00000100:00100000:2.0:1784185000.501181:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb74a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7503:1870853265502336:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1784185000.502753:0:7503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1784185000.502862:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc172d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7503:1870853265502464:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784185000.502923:0:7503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185000.502976:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784185000.503173:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265502464 00000100:00100000:1.0:1784185000.503181:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265502464 00000100:00100000:1.0:1784185000.503242:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784185000.503252:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7503:x1870853265502464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784185000.503661:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7503:x1870853265502464:12345-0@lo:1000:mdt00_003.0 Request processed in 410us (736us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1784185000.503668:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784185000.503716:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc172d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7503:1870853265502464:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784185000.503753:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503763:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503770:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503776:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185000.503781:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503799:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503814:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f87fe3d00) 00010000:00010000:1.0:1784185000.503817:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784185000.503822:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503829:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c200/0x63160f6fbe8b0c1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503858:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503865:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503871:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503876:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185000.503879:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503885:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503892:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f93b83a00) 00010000:00010000:1.0:1784185000.503894:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784185000.503897:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503912:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0b52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503936:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503962:0:7503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503972:0:7503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.503999:0:7503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185000.504012:0:7503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 21 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185000.504024:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1647480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265502592:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784185000.504087:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e812f4180 going to sleep for 11 seconds 00000100:00100000:2.0:1784185000.508232:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1647480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7503:1870853265502592:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185000.508259:0:7503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185000.510861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185000.511194:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239292416 00000100:00100000:0.0:1784185000.511215:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239292416 00010000:00010000:0.0:1784185000.511255:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 22 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185000.511303:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:0.0:1784185000.511314:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2355:x1870853239292416:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185000.511364:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185000.511371:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 22 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.511677:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 22 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.511700:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d000/0x63160f6fbe8b0b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381870cc expref: 22 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.511718:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f93b83a00) 00010000:00010000:0.0:1784185000.511724:0:7492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.511733:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.511741:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.511771:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185000.511827:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2355:x1870853239292416:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 515us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185000.511834:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00010000:00010000:2.0:1784185000.511892:0:7503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511901:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511925:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511931:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511937:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511954:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185000.511959:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511966:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511975:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f93b83a00) 00010000:00010000:2.0:1784185000.511978:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185000.511982:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.511989:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.512000:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.512005:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.512011:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.512022:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185000.512025:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.512031:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.512040:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f93b83a00) 00010000:00010000:2.0:1784185000.512042:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784185000.512045:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185000.512051:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0c16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185000.512267:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+20:11505:x1870853239292160:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 22633us (26435us total) trans 4294967466 rc 0/0 00000040:00080000:3.0:1784185000.512490:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784185000.512496:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784185000.513000:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1784185000.513008:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784185000.513255:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 186 00000020:00080000:2.0:1784185000.513260:0:7503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1784185000.517876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185000.517977:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239292672 00000100:00100000:3.0:1784185000.517987:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239292672 00000100:00100000:3.0:1784185000.518046:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:3.0:1784185000.518057:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:11505:x1870853239292672:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784185000.518779:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784185000.518885:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1784185000.518928:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.518954:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.518968:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.518977:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.518996:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.519003:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185000.519025:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784185000.519112:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+22:11505:x1870853239292672:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1056us (1244us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1784185000.519120:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000020:00080000:3.0:1784185000.519125:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784185000.519837:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185000.519845:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.519853:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185000.519857:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.519866:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.519888:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b5f93b83d00) 00010000:00010000:0.0:1784185000.519891:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784185000.519896:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.519901:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0c2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185000.519918:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185000.519920:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185000.519921:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185000.650851:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265502848:0@lo:400:kworker.0 00000100:00100000:3.0:1784185000.650921:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185000.650999:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784185000.651005:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265502976:0@lo:400:kworker.0 00000100:00100000:3.0:1784185000.651030:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185000.651070:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265502848 00000100:00100000:3.0:1784185000.651077:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265502848 00000100:00100000:3.0:1784185000.651131:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265502976 00000100:00100000:3.0:1784185000.651135:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265502976 00000100:00100000:3.0:1784185000.651166:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784185000.651175:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265502848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185000.651239:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265502848:12345-0@lo:400:kworker.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.651247:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784185000.651264:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784185000.651271:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265502976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185000.651361:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265502976:12345-0@lo:400:kworker.0 Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.651368:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1784185000.651387:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185000.651426:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265502976:0@lo:400:kworker.0 00000100:00100000:3.0:1784185000.651437:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265502848:0@lo:400:kworker.0 00000100:00100000:2.0:1784185000.652075:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265502720:0@lo:400:kworker.0 00000100:00100000:2.0:1784185000.652135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185000.652177:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784185000.652184:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265503104:0@lo:400:kworker.0 00000100:00100000:2.0:1784185000.652220:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185000.654523:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265502720 00000100:00100000:3.0:1784185000.654538:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265502720 00000100:00100000:2.0:1784185000.654836:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265503104 00000100:00100000:2.0:1784185000.654841:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265503104 00000100:00100000:2.0:1784185000.654918:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784185000.654928:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265503104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185000.655051:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265503104:12345-0@lo:400:kworker.0 Request processed in 124us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185000.655059:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784185000.655107:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265503104:0@lo:400:kworker.0 00000100:00080000:1.0:1784185000.655532:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185000.657115:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784185000.657130:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265502720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185000.657218:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3314:x1870853265502720:12345-0@lo:400:kworker.0 Request processed in 92us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185000.657225:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784185000.657288:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265502720:0@lo:400:kworker.0 00000100:00100000:3.0:1784185000.659745:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265503232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784185000.659814:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185000.659881:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265503232 00000100:00100000:2.0:1784185000.659889:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265503232 00000100:00100000:2.0:1784185000.659954:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784185000.659963:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265503232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784185000.659991:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1784185000.660040:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265503232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185000.660046:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784185000.660198:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265503232:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1784185001.280908:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1784185001.281057:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:2.0:1784185001.482935:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185001.550893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185001.551011:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239292800 00000100:00100000:0.0:1784185001.551022:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239292800 00000100:00100000:0.0:1784185001.551084:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 303 00000100:00100000:0.0:1784185001.551098:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239292800:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185001.551197:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239292800:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185001.551205:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 303 00000100:00100000:2.0:1784185001.552066:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185001.552107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185001.552188:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239293312 00000100:00100000:3.0:1784185001.552194:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239293312 00000100:00100000:3.0:1784185001.552258:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:3.0:1784185001.552267:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239293312:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185001.552324:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239293312:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185001.552371:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00080000:1.0:1784185001.552836:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185001.553098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185001.553131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185001.553193:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239292928 00000100:00100000:2.0:1784185001.553199:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239292928 00000100:00100000:2.0:1784185001.553240:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:2.0:1784185001.553249:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2356:x1870853239292928:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185001.553381:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239293056 00000100:00100000:0.0:1784185001.553386:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239293056 00000100:00100000:0.0:1784185001.553417:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239293184 00000100:00100000:0.0:1784185001.553420:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239293184 00000100:00100000:0.0:1784185001.553439:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1784185001.553445:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239293056:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185001.563196:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2356:x1870853239292928:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 9931us (10084us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185001.563214:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:0.0:1784185001.563316:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239293056:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 9867us (11251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185001.563327:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1784185001.563399:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:0.0:1784185001.563412:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239293184:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185001.563492:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239293184:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 85us (10360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185001.563499:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00080000:1.0:1784185001.564028:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784185001.564043:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1784185002.070169:0:12322:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784185002.070240:0:12322:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784185002.070284:0:12322:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1784185002.070289:0:12322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784185002.192801:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784185002.192824:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f882a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265503360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784185002.192896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185002.193638:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265503360 00000100:00100000:3.0:1784185002.193650:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265503360 00000100:00100000:3.0:1784185002.193704:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784185002.193712:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265503360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784185002.193749:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784185002.193806:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265503360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185002.193813:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784185002.193851:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1784185002.193857:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1784185002.193887:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5f84467b80, transno 4294967307 00000100:00100000:3.0:1784185002.193906:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f882a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265503360:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784185002.194616:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784185002.239849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185002.240001:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239293568 00000100:00100000:3.0:1784185002.240011:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239293568 00000100:00100000:3.0:1784185002.240082:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00100000:3.0:1784185002.240092:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+22:11522:x1870853239293568:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784185002.240112:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185002.240133:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0c32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187104 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.240421:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0c39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.240439:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.240453:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185002.240464:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1784185002.240650:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0c32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187104 expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.240668:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0c39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187104 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.240675:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784185002.240678:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784185002.240681:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f600, rc 0) 00000100:00100000:3.0:1784185002.240751:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+24:11522:x1870853239293568:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 661us (913us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1784185002.240759:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00100000:2.0:1784185002.246840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185002.246908:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239293696 00000100:00100000:3.0:1784185002.246928:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239293696 00000100:00100000:3.0:1784185002.246988:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00100000:3.0:1784185002.246999:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+24:11522:x1870853239293696:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1784185002.247271:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.247299:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.247312:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.247328:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.247366:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.247373:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.247940:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.247951:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.247966:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784185002.248006:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248018:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248024:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248030:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248035:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.248039:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248057:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248070:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784185002.248073:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.248077:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248082:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0c47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248094:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248105:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248111:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248116:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.248120:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248125:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248134:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f93b83100) 00010000:00010000:2.0:1784185002.248136:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.248138:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248145:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248302:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248309:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248313:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248318:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.248327:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248367:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248375:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f988b7c00) 00010000:00010000:2.0:1784185002.248378:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.248380:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.248385:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185002.248472:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+24:11522:x1870853239293696:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1473us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185002.248481:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00100000:2.0:1784185002.323822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185002.323988:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239293952 00000100:00100000:1.0:1784185002.324000:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239293952 00000100:00100000:1.0:1784185002.324082:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 189 00000100:00100000:1.0:1784185002.324092:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+24:11525:x1870853239293952:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784185002.324115:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185002.324136:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818710b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324224:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324241:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324253:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324267:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324274:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324281:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324680:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324689:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324704:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185002.324715:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1784185002.324820:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324828:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324834:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324840:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185002.324845:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324852:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324864:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:1.0:1784185002.324866:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185002.324870:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324876:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0c63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324887:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324893:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324905:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324910:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185002.324923:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324929:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324937:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784185002.324939:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185002.324942:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324947:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.324989:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.325002:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.325023:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:1.0:1784185002.325025:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784185002.325028:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8200, rc 0) 00000100:00100000:1.0:1784185002.325096:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+26:11525:x1870853239293952:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1006us (1284us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1784185002.325114:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 189 00000100:00100000:0.0:1784185002.330578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185002.330671:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239294080 00000100:00100000:1.0:1784185002.330680:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239294080 00000100:00100000:1.0:1784185002.330752:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:1.0:1784185002.330764:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:11525:x1870853239294080:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1784185002.330842:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330860:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330872:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330902:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330909:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330930:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330936:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185002.330940:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330946:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330958:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:1.0:1784185002.330970:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784185002.330975:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.330981:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0c7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185002.331081:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:11525:x1870853239294080:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 319us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185002.331090:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:1.0:1784185002.358761:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185002.358904:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239294336 00000100:00100000:3.0:1784185002.358926:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239294336 00000100:00100000:3.0:1784185002.358977:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1784185002.358987:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:11525:x1870853239294336:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1784185002.359254:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+27:11525:x1870853239294336:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 268us (503us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1784185002.359263:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1784185002.421476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185002.421853:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239294592 00000100:00100000:3.0:1784185002.421862:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239294592 00000100:00100000:3.0:1784185002.422000:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:3.0:1784185002.422011:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+27:11051:x1870853239294592:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784185002.422072:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185002.422113:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0c86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187112 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.422237:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.422252:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.422260:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.422296:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.422309:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 28 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185002.422322:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265503488:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784185002.422440:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784185002.427218:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265503488:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784185002.427253:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185002.429552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185002.430133:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239294720 00000100:00100000:0.0:1784185002.430144:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239294720 00010000:00010000:0.0:1784185002.430196:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 29 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185002.430231:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:0.0:1784185002.430240:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+29:2355:x1870853239294720:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185002.430255:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185002.430262:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 29 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.430274:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 29 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.430295:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8200/0x63160f6fbe8b0c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818710b expref: 29 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.430311:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:0.0:1784185002.430316:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.430358:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.430367:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.430391:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784185002.430415:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.430426:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185002.430439:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1646680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+28:2355:x1870853239294720:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 198us (894us total) trans 0 rc 0/0 00000004:00200000:3.0:1784185002.430446:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:0.0:1784185002.430448:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00010000:00010000:3.0:1784185002.430622:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0c86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.430831:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.431417:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:3.0:1784185002.431420:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784185002.431423:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e600, rc 0) 00000100:00100000:3.0:1784185002.431470:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+28:11051:x1870853239294592:12345-192.168.201.29@tcp:101:bash.0 Request processed in 9460us (10004us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1784185002.431478:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:1.0:1784185002.441850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185002.441978:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239294976 00000100:00100000:2.0:1784185002.441988:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239294976 00000100:00100000:2.0:1784185002.442045:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 192 00000100:00100000:2.0:1784185002.442057:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+28:11051:x1870853239294976:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:1.0:1784185002.442446:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.442465:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.442479:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784185002.442539:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1784185002.442572:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb2e92c0 reply state 000000006147d51b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185002.442582:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784185002.442633:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1784185002.442743:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11051:x1870853239294976:12345-192.168.201.29@tcp:36:bash.0 Request processed in 686us (899us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1784185002.442769:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 192 00000020:00080000:1.0:1784185002.442774:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1784185002.455129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:2.0:1784185002.455141:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185002.455217:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239295104 00010000:00010000:2.0:1784185002.455223:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185002.455226:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239295104 00010000:00010000:2.0:1784185002.455236:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.455260:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.455266:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.455274:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185002.455284:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 193 00010000:00010000:2.0:1784185002.455292:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00000100:00100000:3.0:1784185002.455296:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11051:x1870853239295104:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784185002.455297:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.455304:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.455312:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0c9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.455322:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185002.455382:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0ca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187119 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.455436:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187119 expref: 32 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.455449:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187119 expref: 32 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.455465:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:3.0:1784185002.455474:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185002.455477:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896fa00, rc 0) 00000100:00100000:3.0:1784185002.455538:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11051:x1870853239295104:12345-192.168.201.29@tcp:101:bash.0 Request processed in 246us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185002.455544:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 193 00000100:00100000:2.0:1784185002.469590:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185002.469678:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239295232 00000100:00100000:0.0:1784185002.469688:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239295232 00000100:00100000:0.0:1784185002.469768:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:0.0:1784185002.469778:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:11051:x1870853239295232:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784185002.469796:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185002.469817:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187120 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784185002.469826:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1784185002.469845:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5880a6, atime: 0x6a5880a4, ctime: 0x6a5880a6, blocks: 0xb 00010000:00010000:0.0:1784185002.469872:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1784185002.469876:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185002.469885:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.469901:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.469969:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d400, rc 0) 00000100:00100000:0.0:1784185002.470041:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:11051:x1870853239295232:12345-192.168.201.29@tcp:101:bash.0 Request processed in 264us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185002.470048:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1784185002.479035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185002.479195:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239295360 00000100:00100000:2.0:1784185002.479204:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239295360 00002000:00010000:2.0:1784185002.479239:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1784185002.479243:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fc1644380 with x1870853239295360 ext(0->18446744073709551615) 00002000:00010000:2.0:1784185002.479254:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fc1644380. 00000100:00100000:2.0:1784185002.479284:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1784185002.479292:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2355:x1870853239295360:12345-192.168.201.29@tcp:10:bash.0 00002000:00010000:2.0:1784185002.479662:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1784185002.479666:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1784184998 -> 1784185002 00002000:00010000:2.0:1784185002.479669:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1784184996 -> 1784184996 00002000:00010000:2.0:1784185002.479671:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784184998 -> 1784185002 00002000:00010000:2.0:1784185002.479673:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1784185002.479751:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239295360:12345-192.168.201.29@tcp:10:bash.0 Request processed in 459us (725us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1784185002.479758:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00002000:00010000:2.0:1784185002.479762:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1784185002.479764:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fc1644380 with x1870853239295360 ext(0->18446744073709551615) 00002000:00010000:2.0:1784185002.479769:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fc1644380. 00010000:00010000:2.0:1784185002.507771:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185002.600920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185002.601090:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239295488 00000100:00100000:2.0:1784185002.601100:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239295488 00000100:00100000:2.0:1784185002.601165:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:2.0:1784185002.601175:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11539:x1870853239295488:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1784185002.601249:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601266:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601277:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601292:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601299:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601305:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601699:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601901:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601922:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784185002.601970:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601982:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601989:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.601996:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602002:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.602006:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602013:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602024:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784185002.602027:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.602031:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602037:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602058:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602064:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602070:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602075:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.602078:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602095:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602103:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f988b7c00) 00010000:00010000:2.0:1784185002.602106:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.602109:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602114:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602129:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602136:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602141:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602151:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.602154:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602159:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602166:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:2.0:1784185002.602169:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.602172:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.602177:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0cbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185002.602411:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11539:x1870853239295488:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1236us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185002.602421:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:3.0:1784185002.704060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185002.704293:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239295744 00000100:00100000:1.0:1784185002.704303:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239295744 00000100:00100000:1.0:1784185002.704400:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 195 00000100:00100000:1.0:1784185002.704410:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+32:11543:x1870853239295744:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784185002.704430:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185002.704451:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b0cc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187127 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704530:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704544:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704555:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704569:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704575:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704582:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704896:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0cda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704927:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.704935:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0cda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185002.704944:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784185002.705039:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705047:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705054:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705060:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185002.705064:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705071:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705082:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:1.0:1784185002.705084:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185002.705089:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705104:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ccc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705117:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705122:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705128:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705133:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185002.705136:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705141:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705148:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784185002.705150:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185002.705152:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705158:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705194:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b0cc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187127 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705206:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0cda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187127 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.705218:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:1.0:1784185002.705220:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784185002.705222:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9600, rc 0) 00000100:00100000:1.0:1784185002.705295:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11543:x1870853239295744:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 886us (1244us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1784185002.705302:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 195 00000100:00100000:1.0:1784185002.717846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185002.717957:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239295872 00000100:00100000:0.0:1784185002.717968:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239295872 00000100:00100000:0.0:1784185002.718032:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:0.0:1784185002.718043:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11543:x1870853239295872:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1784185002.718111:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.718128:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.718137:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.718174:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.718187:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 34 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185002.718203:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f84467b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265503616:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784185002.718303:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f89fb0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784185002.721757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185002.722207:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239296128 00000100:00100000:3.0:1784185002.722216:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239296128 00000100:00100000:3.0:1784185002.722279:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1784185002.722289:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+35:5571:x1870853239296128:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784185002.722657:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+36:5571:x1870853239296128:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 369us (907us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1784185002.722666:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1784185002.726221:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185002.726439:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239296256 00000100:00100000:0.0:1784185002.726449:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239296256 00010000:00010000:0.0:1784185002.726488:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 36 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185002.726541:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:0.0:1784185002.726550:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f91f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+36:2356:x1870853239296256:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185002.726566:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185002.726574:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 36 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.726587:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 36 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.726610:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:0.0:1784185002.726616:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.726627:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.726635:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.726659:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185002.726716:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f91f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+36:2356:x1870853239296256:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 167us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185002.726724:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00010000:00010000:2.0:1784185002.728034:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e600/0x63160f6fbe8b0c8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187112 expref: 35 pid: 5793 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185002.728057:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f84467b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265503616:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185002.728091:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728102:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728107:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728155:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728163:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728698:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728705:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.728710:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728719:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728740:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:2.0:1784185002.728743:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784185002.728747:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.728754:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0ce8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185002.728855:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11543:x1870853239295872:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 10812us (11024us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185002.728865:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:3.0:1784185002.739427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185002.739544:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239296512 00000100:00100000:0.0:1784185002.739567:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239296512 00000100:00100000:0.0:1784185002.739619:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1784185002.739629:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+34:11543:x1870853239296512:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784185002.739879:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+35:11543:x1870853239296512:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 250us (461us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1784185002.739886:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1784185002.912784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185002.912995:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239296768 00000100:00100000:1.0:1784185002.913006:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239296768 00000100:00100000:1.0:1784185002.913072:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 197 00000100:00100000:1.0:1784185002.913082:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+35:11554:x1870853239296768:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1784185002.913106:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185002.913128:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b0cef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818712e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913206:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913221:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913234:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913249:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913257:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913278:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913943:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0d04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913955:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.913964:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185002.913975:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1784185002.914067:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914075:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914081:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914087:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185002.914092:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914100:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914111:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:1.0:1784185002.914114:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185002.914125:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914131:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0cf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914144:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914150:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914155:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914161:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185002.914163:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914170:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914178:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784185002.914180:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185002.914183:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914188:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914238:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8600/0x63160f6fbe8b0cef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818712e expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914268:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0d04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818712e expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185002.914275:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:1.0:1784185002.914277:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784185002.914279:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9e00, rc 0) 00000100:00100000:1.0:1784185002.914492:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11554:x1870853239296768:12345-192.168.201.29@tcp:101:cat.0 Request processed in 1409us (1717us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1784185002.914501:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 197 00000100:00100000:3.0:1784185002.931457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185002.931695:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239297024 00000100:00100000:0.0:1784185002.931705:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239297024 00000100:00100000:0.0:1784185002.931774:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:0.0:1784185002.931785:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11554:x1870853239297024:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:0.0:1784185002.932050:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+38:11554:x1870853239297024:12345-192.168.201.29@tcp:35:cat.0 Request processed in 266us (602us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1784185002.932058:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:3.0:1784185002.967439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185002.967554:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239297280 00000100:00100000:2.0:1784185002.967565:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239297280 00000100:00100000:2.0:1784185002.967616:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:2.0:1784185002.967647:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+38:11555:x1870853239297280:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:2.0:1784185002.967705:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784185002.967732:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9e00/0x63160f6fbe8b0d04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818712e expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967753:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0cda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187127 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967766:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896fa00/0x63160f6fbe8b0ca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187119 expref: 36 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967776:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f8c4f5a00) 00010000:00010000:2.0:1784185002.967790:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784185002.967811:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967824:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967834:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967846:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967853:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.967859:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.968167:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.968177:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.968184:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784185002.968867:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1784185002.968877:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401134545017ns, next at 402134543005ns, rc = 0 00010000:00010000:2.0:1784185002.968966:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.968977:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.968986:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.968994:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969000:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969007:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969034:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185002.969053:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969066:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969072:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969078:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.969083:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969091:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969101:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f988b7100) 00010000:00010000:2.0:1784185002.969104:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784185002.969108:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969113:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969130:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969136:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969142:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969146:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185002.969156:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969162:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969170:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784185002.969172:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185002.969175:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185002.969181:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784185002.969190:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d932921 reply state 00000000b0cf7970 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185002.969199:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784185002.969279:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+37:11555:x1870853239297280:12345-192.168.201.29@tcp:36:rm.0 Request processed in 1632us (1846us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1784185002.969287:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 198 00010000:00010000:3.0:1784185002.969640:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784185002.969648:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.969654:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784185002.969658:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.969664:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.969675:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b5f988b7100) 00010000:00010000:3.0:1784185002.969685:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784185002.969689:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.969694:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c800/0x63160f6fbe8b0d27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185002.969711:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185002.969713:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185002.969715:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185002.974742:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.974770:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.974778:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.974784:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185002.974789:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.974796:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.974827:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f988b7c00) 00010000:00010000:0.0:1784185002.974830:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185002.974849:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185002.974856:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d000/0x63160f6fbe8b0d19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185003.035700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.036121:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239297536 00000100:00100000:2.0:1784185003.036132:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239297536 00000100:00100000:2.0:1784185003.036223:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 199 00000100:00100000:2.0:1784185003.036234:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+36:11561:x1870853239297536:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784185003.036262:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185003.036285:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187135 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784185003.037032:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784185003.037159:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.037188:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.037200:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.037214:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.037221:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.037227:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784185003.038350:0:7503:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1784185003.038514:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038590:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038599:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038635:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038642:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038649:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038662:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185003.038667:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038674:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038685:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784185003.038688:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185003.038692:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.038699:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784185003.038710:0:7503:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000401a44bd reply state 000000002a978eaa transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185003.038718:0:7503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784185003.038748:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 39 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.039581:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 38 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.039591:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f988b7a00) 00010000:00010000:2.0:1784185003.039594:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784185003.039597:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158de00, rc 0) 00000100:00100000:2.0:1784185003.039678:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+39:11561:x1870853239297536:12345-192.168.201.29@tcp:101:bash.0 Request processed in 3446us (3989us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1784185003.039694:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 199 00010000:00010000:2.0:1784185003.052922:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.052939:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.052947:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.052954:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185003.052959:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.052967:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.052985:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f988b7e00) 00010000:00010000:2.0:1784185003.052988:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185003.052993:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.052999:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0d3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185003.053386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.053701:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239297664 00000100:00100000:0.0:1784185003.053711:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239297664 00000100:00100000:0.0:1784185003.053792:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:0.0:1784185003.053802:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239297664:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1784185003.053818:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185003.053837:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818713c expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784185003.053863:0:10137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784185003.053885:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1784185003.053890:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185003.053909:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 6 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.053928:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 6 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.053941:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784185003.054018:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2354:x1870853239297664:12345-192.168.201.29@tcp:101:bash.0 Request processed in 217us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185003.054025:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00080000:3.0:1784185003.054585:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784185003.069493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.069641:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239297792 00000100:00100000:2.0:1784185003.069651:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239297792 00000100:00100000:2.0:1784185003.069710:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:2.0:1784185003.069720:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+6:11561:x1870853239297792:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784185003.069738:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185003.069782:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187143 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.069816:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 7 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.069826:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185003.069830:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185003.069835:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.069869:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 7 pid: 10137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.069884:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 7 pid: 10137 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185003.069898:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1870853265503744:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784185003.069999:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185003.089015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185003.089156:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239297920 00000100:00100000:3.0:1784185003.089168:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239297920 00010000:00010000:3.0:1784185003.089210:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 8 pid: 10137 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185003.089253:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:3.0:1784185003.089262:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239297920:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185003.089275:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185003.089299:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 8 pid: 10137 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.089312:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 8 pid: 10137 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.089388:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185003.089393:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185003.089414:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.089426:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.089467:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185003.089482:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5778:1870853265503872:192.168.201.29@tcp:105: 00000100:00100000:3.0:1784185003.089554:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddfa80 going to sleep for 11 seconds 00010000:00010000:2.0:1784185003.090702:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b0d51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818713c expref: 8 pid: 10137 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185003.090722:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6588:1870853265503744:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185003.090756:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.090789:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d400, rc 0) 00000100:00100000:2.0:1784185003.090954:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:11561:x1870853239297792:12345-192.168.201.29@tcp:101:bash.0 Request processed in 21234us (21471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185003.090964:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:3.0:1784185003.112604:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5778:1870853265503872:192.168.201.29@tcp:105: 00010000:00010000:3.0:1784185003.112634:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185003.112709:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2356:x1870853239297920:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 23439us (23697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185003.112720:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:3.0:1784185003.118819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.118895:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239298176 00000100:00100000:0.0:1784185003.118982:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239298176 00000100:00100000:0.0:1784185003.119105:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1784185003.119116:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+38:11561:x1870853239298176:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1784185003.119511:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+39:11561:x1870853239298176:12345-192.168.201.29@tcp:35:bash.0 Request processed in 395us (700us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1784185003.119520:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:1.0:1784185003.411423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.411766:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239298304 00000100:00100000:2.0:1784185003.411777:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239298304 00000100:00100000:2.0:1784185003.411839:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:2.0:1784185003.411849:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+39:11577:x1870853239298304:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185003.411875:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185003.411907:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818714a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.411974:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.411989:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.412000:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185003.412059:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1784185003.412063:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185003.412084:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.412108:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818714a expref: 41 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.412147:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818714a expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.412156:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784185003.412159:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784185003.412162:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158cc00, rc 0) 00000100:00100000:2.0:1784185003.412228:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+40:11577:x1870853239298304:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 380us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185003.412236:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:3.0:1784185003.416041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185003.416374:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239298560 00000100:00100000:1.0:1784185003.416387:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239298560 00000100:00100000:1.0:1784185003.416453:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 201 00000100:00100000:1.0:1784185003.416463:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+40:11577:x1870853239298560:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784185003.416488:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185003.416510:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0d6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187151 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.416630:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.416644:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.416656:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185003.416685:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784185003.416824:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0d6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187151 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.416842:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187151 expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.416851:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f988b7a00) 00010000:00010000:1.0:1784185003.416853:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784185003.416856:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9400, rc 0) 00000100:00100000:1.0:1784185003.416930:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+42:11577:x1870853239298560:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 469us (899us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1784185003.416938:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 201 00000100:00100000:3.0:1784185003.424308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.424872:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239298816 00000100:00100000:2.0:1784185003.424886:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239298816 00000100:00100000:2.0:1784185003.424965:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:2.0:1784185003.424976:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f882a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+42:11577:x1870853239298816:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185003.425003:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185003.425026:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187158 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.425138:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0d89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.425152:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.425162:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185003.425175:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784185003.425323:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0d82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187158 expref: 45 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.425596:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0d89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187158 expref: 44 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.425603:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f988b7a00) 00010000:00010000:2.0:1784185003.425606:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784185003.425609:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c400, rc 0) 00000100:00100000:2.0:1784185003.425673:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f882a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+44:11577:x1870853239298816:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 698us (1375us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1784185003.425680:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:0.0:1784185003.429408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.430380:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239298944 00000100:00100000:2.0:1784185003.430394:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239298944 00000100:00100000:2.0:1784185003.430463:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1784185003.430473:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+44:2356:x1870853239298944:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784185003.430489:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185003.430524:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187151 expref: 44 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.430544:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f988b7a00) 00010000:00010000:2.0:1784185003.430549:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185003.430611:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+43:2356:x1870853239298944:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 140us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185003.430619:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784185003.440060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.440179:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239299072 00000100:00100000:0.0:1784185003.440189:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239299072 00000100:00100000:0.0:1784185003.440252:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:0.0:1784185003.440262:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f85ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+6:2353:x1870853239299072:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:0.0:1784185003.440360:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.440382:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.440390:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185003.440394:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185003.440398:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.440452:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 6 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.440467:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 6 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185003.440482:0:10137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf5ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10137:1870853265504000:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784185003.440585:0:10137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249840 going to sleep for 11 seconds 00000100:00100000:0.0:1784185003.444365:0:10137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf5ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10137:1870853265504000:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784185003.444409:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185003.450112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.450229:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239299200 00000100:00100000:0.0:1784185003.450240:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239299200 00002000:00100000:0.0:1784185003.450298:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b5f83367100 x1870853239299200/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:724/0 lens 504/0 e 0 to 0 dl 1784185014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784185003.450310:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f83367100 with x1870853239299200 ext(0->8) 00010000:00010000:0.0:1784185003.450320:0:6594:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 7 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.450362:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 7 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784185003.450371:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5f83367100 00000100:00100000:0.0:1784185003.450428:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1784185003.450438:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2355:x1870853239299200:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:0.0:1784185003.450968:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2355:x1870853239299200:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 529us (868us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784185003.450976:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00002000:00100000:0.0:1784185003.450983:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b5f83367100 x1870853239299200/t4294967308(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:724/0 lens 504/448 e 0 to 0 dl 1784185014 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784185003.450991:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f83367100 with x1870853239299200 ext(0->8) 00010000:00010000:0.0:1784185003.450997:0:6594:0:(ldlm_extent.c:754:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 9 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.451008:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 9 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784185003.451015:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b5f83367100 00000100:00100000:3.0:1784185003.460125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.460285:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239299328 00000100:00100000:0.0:1784185003.460295:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239299328 00010000:00010000:0.0:1784185003.460362:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 9 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185003.460407:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1784185003.460417:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2356:x1870853239299328:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185003.460432:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784185003.460462:0:5779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784185003.460465:0:5779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784185002 00002000:00010000:0.0:1784185003.460480:0:5779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784185003 00002000:00010000:0.0:1784185003.460482:0:5779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784185002 00010000:00010000:0.0:1784185003.460489:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 9 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.460503:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 9 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.460792:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e73efc/0x63160f6fbe8b0d58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de9626838187143 expref: 9 pid: 6588 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.460811:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185003.460816:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185003.460822:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.460878:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.460991:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185003.461062:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239299328:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 646us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185003.461072:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00010000:00010000:1.0:1784185003.466197:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466219:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466262:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466271:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466279:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466303:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185003.466307:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466316:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466505:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.466525:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b0d97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185003.466637:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f85ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2353:x1870853239299072:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 26372us (26581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185003.466647:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1784185003.472436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.472517:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239299584 00000100:00100000:2.0:1784185003.472548:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239299584 00000100:00100000:2.0:1784185003.472617:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1784185003.472955:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+43:11577:x1870853239299584:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:2.0:1784185003.473020:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0d89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187158 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784185003.473306:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1784185003.473499:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1784185003.473982:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1784185003.474039:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.474056:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 47 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.474067:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.474100:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 47 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.474116:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 47 pid: 7503 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185003.474131:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1870853265504128:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784185003.477026:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88247f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784185003.482220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185003.482326:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239299712 00000100:00100000:1.0:1784185003.482373:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239299712 00010000:00010000:1.0:1784185003.482418:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 48 pid: 7503 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185003.482453:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:1.0:1784185003.482462:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+48:2355:x1870853239299712:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784185003.482477:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784185003.482484:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 48 pid: 7503 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.482519:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 48 pid: 7503 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.482541:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f988b7a00) 00010000:00010000:1.0:1784185003.482546:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.482555:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.482563:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.482582:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784185003.482645:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+48:2355:x1870853239299712:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 183us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185003.482653:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00010000:00010000:2.0:1784185003.483821:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0d43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187135 expref: 47 pid: 7503 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185003.483857:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1870853265504128:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185003.483890:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.483909:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.483915:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784185003.484051:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1784185003.484247:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1784185003.484390:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1870853265504256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784185003.484442:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185003.484470:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784185003.485154:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265504256 00000100:00100000:1.0:1784185003.485163:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265504256 00000100:00100000:1.0:1784185003.485223:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784185003.485233:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1870853265504256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784185003.485357:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1870853265504256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185003.485366:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784185003.485467:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1870853265504256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784185003.486045:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1784185003.486129:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1870853265504384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784185003.486183:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185003.486218:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784185003.486909:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265504384 00000100:00100000:1.0:1784185003.486919:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265504384 00000100:00100000:1.0:1784185003.486960:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784185003.486970:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1870853265504384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784185003.487223:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1870853265504384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 255us (1039us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784185003.487231:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784185003.487595:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1870853265504384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784185003.487682:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1784185003.487730:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.487741:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.487944:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.487952:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185003.487956:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.487963:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.487981:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f988b7a00) 00010000:00010000:3.0:1784185003.487984:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784185003.487989:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.487995:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0d9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784185003.488202:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784185003.488290:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1784185003.488301:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401653968089ns, next at 402653966133ns, rc = 0 00000001:00080000:3.0:1784185003.488319:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1784185003.488407:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f988b7a00) 00010000:00010000:3.0:1784185003.488411:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784185003.488417:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0d89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187158 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185003.489062:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+50:11577:x1870853239299584:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 16434us (16633us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1784185003.489072:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000020:00080000:3.0:1784185003.489078:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784185003.494074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185003.494229:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239299840 00000100:00100000:1.0:1784185003.494240:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239299840 00000100:00100000:1.0:1784185003.494355:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:1.0:1784185003.494365:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+50:11577:x1870853239299840:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784185003.494387:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185003.494407:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0da5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818715f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.494462:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818715f expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.494476:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818715f expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185003.494492:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784185003.494495:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784185003.494498:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8800, rc 0) 00000100:00100000:1.0:1784185003.494560:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+51:11577:x1870853239299840:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 196us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185003.494566:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:3.0:1784185003.498426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.498629:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239300096 00000100:00100000:0.0:1784185003.498639:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239300096 00000100:00100000:0.0:1784185003.498713:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1784185003.498722:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+51:11577:x1870853239300096:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784185003.498997:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11577:x1870853239300096:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 274us (580us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1784185003.499005:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00010000:00010000:2.0:1784185003.532126:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185003.650800:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.650973:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239300224 00000100:00100000:0.0:1784185003.650982:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239300224 00000100:00100000:0.0:1784185003.651045:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:0.0:1784185003.651054:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11587:x1870853239300224:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:0.0:1784185003.651133:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651151:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651288:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651307:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651314:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651321:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651591:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651617:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651625:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784185003.651666:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651678:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651684:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651689:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651694:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185003.651698:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651705:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651716:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784185003.651719:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185003.651723:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651728:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d200/0x63160f6fbe8b0dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651747:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651754:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651758:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651762:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631cc00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185003.651765:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651771:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651777:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f87fe3400) 00010000:00010000:0.0:1784185003.651779:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185003.651782:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651786:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0db3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651799:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651805:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651810:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651821:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185003.651824:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651829:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651837:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:0.0:1784185003.651840:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185003.651843:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.651848:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185003.652251:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11587:x1870853239300224:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1195us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185003.652262:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:0.0:1784185003.740500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.740803:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239300480 00000100:00100000:2.0:1784185003.740813:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239300480 00000100:00100000:2.0:1784185003.740882:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:2.0:1784185003.740902:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+52:11590:x1870853239300480:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185003.740923:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185003.740946:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0dc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187166 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741024:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741039:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741051:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741081:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741088:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741095:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741228:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b0dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741237:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b0dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741245:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b0dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185003.741255:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784185003.741407:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741416:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741422:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741427:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158da00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185003.741433:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741499:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741574:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784185003.741577:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185003.741582:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741589:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0dc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741603:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741610:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741616:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741621:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185003.741624:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741630:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741636:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f988b7e00) 00010000:00010000:2.0:1784185003.741639:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185003.741642:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741657:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741698:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0dc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187166 expref: 55 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741711:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b0dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187166 expref: 54 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.741718:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185003.741720:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784185003.741722:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158ce00, rc 0) 00000100:00100000:2.0:1784185003.741937:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11590:x1870853239300480:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1044us (1444us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1784185003.741945:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:0.0:1784185003.748031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185003.748643:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239300608 00000100:00100000:2.0:1784185003.748653:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239300608 00000100:00100000:2.0:1784185003.748715:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:2.0:1784185003.748725:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11590:x1870853239300608:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1784185003.748792:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748808:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748821:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748865:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748872:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748879:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748885:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185003.748901:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748910:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748923:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185003.748927:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784185003.748932:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185003.748939:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185003.749638:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11590:x1870853239300608:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 910us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185003.749647:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:2.0:1784185003.760428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.760536:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239300864 00000100:00100000:0.0:1784185003.760547:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239300864 00000100:00100000:0.0:1784185003.760611:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:0.0:1784185003.760621:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+54:11590:x1870853239300864:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784185003.760864:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11590:x1870853239300864:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 244us (444us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1784185003.760871:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1784185003.980856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185003.980968:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239301120 00000100:00100000:3.0:1784185003.980978:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239301120 00000100:00100000:3.0:1784185003.981046:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 207 00000100:00100000:3.0:1784185003.981055:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+55:11600:x1870853239301120:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784185003.981083:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185003.981086:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784185003.981118:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158cc00/0x63160f6fbe8b0d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818714a expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.981137:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784185003.981142:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784185003.981167:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0deb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818716d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.981277:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0df2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.981308:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.981319:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0df2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185003.981387:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784185003.981541:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0deb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818716d expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.981557:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0df2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818716d expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185003.981565:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185003.981567:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185003.981570:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f200, rc 0) 00000100:00100000:3.0:1784185003.981639:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11600:x1870853239301120:12345-192.168.201.29@tcp:101:bash.0 Request processed in 584us (795us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1784185003.981647:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 207 00000100:00100000:1.0:1784185003.991059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185003.991467:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239301376 00000100:00100000:0.0:1784185003.991491:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239301376 00000100:00100000:0.0:1784185003.991567:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00100000:0.0:1784185003.991577:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11600:x1870853239301376:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1784185003.991635:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784185003.991663:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f200/0x63160f6fbe8b0df2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818716d expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.991685:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b0dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187166 expref: 55 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.991696:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:0.0:1784185003.991701:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784185003.991975:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.991990:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185003.991999:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784185003.992050:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1784185003.992072:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c6af80a reply state 0000000002d9f41b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185003.992081:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784185003.992564:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+57:11600:x1870853239301376:12345-192.168.201.29@tcp:36:bash.0 Request processed in 986us (1512us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1784185003.992572:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 208 00000020:00080000:0.0:1784185003.992578:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784185004.001236:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.001253:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.001260:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.001266:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185004.001271:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.001278:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.001294:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:0.0:1784185004.001297:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185004.001302:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.001308:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.003445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.004040:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239301504 00000100:00100000:3.0:1784185004.004055:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239301504 00000100:00100000:3.0:1784185004.004197:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 209 00000100:00100000:3.0:1784185004.004208:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+56:11600:x1870853239301504:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784185004.004233:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185004.004255:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187174 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.004403:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.004418:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.004429:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185004.004459:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784185004.004464:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185004.004485:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.004528:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.004548:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.004557:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185004.004560:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185004.004564:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e200, rc 0) 00000100:00100000:3.0:1784185004.004632:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+57:11600:x1870853239301504:12345-192.168.201.29@tcp:101:bash.0 Request processed in 425us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.004639:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 209 00000100:00100000:1.0:1784185004.016575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185004.016679:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239301760 00000100:00100000:0.0:1784185004.016690:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239301760 00000100:00100000:0.0:1784185004.016740:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:0.0:1784185004.016750:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+57:11600:x1870853239301760:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1784185004.017014:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+58:11600:x1870853239301760:12345-192.168.201.29@tcp:35:bash.0 Request processed in 264us (447us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1784185004.017023:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:1.0:1784185004.149272:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185004.149451:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239301888 00000100:00100000:0.0:1784185004.149461:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239301888 00000100:00100000:0.0:1784185004.149523:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:0.0:1784185004.149533:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+58:11606:x1870853239301888:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1784185004.149568:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185004.149590:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818717b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.149657:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.149672:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.149684:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784185004.149742:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784185004.149746:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784185004.149768:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.149793:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ca00/0x63160f6fbe8b0e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818717b expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.149810:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818717b expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.149817:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:0.0:1784185004.149820:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784185004.149838:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631cc00, rc 0) 00000100:00100000:0.0:1784185004.149913:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11606:x1870853239301888:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 381us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185004.149921:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:1.0:1784185004.155000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.155086:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239302016 00000100:00100000:3.0:1784185004.155097:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239302016 00000100:00100000:3.0:1784185004.155175:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:3.0:1784185004.155185:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11606:x1870853239302016:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784185004.155208:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185004.155233:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187182 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155315:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155364:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155378:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155395:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155403:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155410:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155546:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155555:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155562:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185004.155617:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784185004.155622:0:7503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185004.155647:0:7503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155659:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155668:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155674:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155681:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155687:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185004.155692:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155700:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155714:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784185004.155717:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185004.155723:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155729:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155755:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155761:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155767:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155772:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185004.155775:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155783:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.155790:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f93b83e00) 00010000:00010000:3.0:1784185004.155793:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185004.155796:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.156229:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.156272:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187182 expref: 61 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.156286:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187182 expref: 60 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.156306:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185004.156309:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185004.156312:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f800, rc 0) 00000100:00100000:3.0:1784185004.156397:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11606:x1870853239302016:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1213us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.156405:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:1.0:1784185004.174977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.175046:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185004.175141:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239302400 00000100:00100000:0.0:1784185004.175141:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239302144 00000100:00100000:2.0:1784185004.175150:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239302400 00000100:00100000:0.0:1784185004.175150:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239302144 00000100:00100000:2.0:1784185004.175218:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:0.0:1784185004.175218:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1784185004.175228:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:11606:x1870853239302400:12345-192.168.201.29@tcp:101:lfs.0 00000100:00100000:0.0:1784185004.175228:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:2355:x1870853239302144:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185004.175244:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185004.175247:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185004.175264:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187189 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.175266:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187182 expref: 61 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.175284:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:0.0:1784185004.175288:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185004.175371:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:2355:x1870853239302144:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 145us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185004.175379:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:2.0:1784185004.175401:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.175414:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.175423:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.175453:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.175466:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 60 pid: 5793 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185004.175479:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc172e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265504512:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784185004.175554:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7b840 going to sleep for 11 seconds 00000100:00100000:2.0:1784185004.179938:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc172e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265504512:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185004.179965:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185004.184357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.184508:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239302528 00000100:00100000:1.0:1784185004.184519:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239302528 00010000:00010000:1.0:1784185004.184560:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 61 pid: 5793 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.184603:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:1.0:1784185004.184612:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+61:2356:x1870853239302528:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784185004.184638:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784185004.184646:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 61 pid: 5793 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.184658:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 61 pid: 5793 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.184679:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187174 expref: 61 pid: 5793 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.184694:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784185004.184699:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.184708:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.184716:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.184763:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784185004.184816:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:2356:x1870853239302528:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 204us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185004.184824:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00010000:00010000:3.0:1784185004.184965:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.184975:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185004.185003:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784185004.185152:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.185168:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.185175:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185004.185177:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784185004.185179:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c600, rc 0) 00000100:00100000:3.0:1784185004.185219:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11606:x1870853239302400:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 9993us (10173us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1784185004.185226:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:0.0:1784185004.194124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.194254:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239302784 00000100:00100000:3.0:1784185004.194264:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239302784 00000100:00100000:3.0:1784185004.194370:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1784185004.194380:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f91f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11606:x1870853239302784:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:3.0:1784185004.194396:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185004.194423:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0da5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818715f expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.194443:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185004.194448:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185004.194520:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f91f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11606:x1870853239302784:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 141us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.194529:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784185004.202061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.202158:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239302912 00000100:00100000:3.0:1784185004.202170:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239302912 00000100:00100000:3.0:1784185004.202231:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:3.0:1784185004.202242:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11606:x1870853239302912:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:3.0:1784185004.202373:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.202390:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.202403:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784185004.202601:0:7503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1784185004.202681:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11606:x1870853239302912:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 440us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.202690:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:1.0:1784185004.211540:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185004.211823:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239303040 00000100:00100000:2.0:1784185004.211854:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239303040 00000100:00100000:2.0:1784185004.211927:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:2.0:1784185004.211939:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+59:11606:x1870853239303040:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185004.211961:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185004.211985:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187190 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.212041:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.212053:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.212073:0:5792:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.212086:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.212099:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185004.212102:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784185004.212105:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.212112:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d800, rc 0) 00000100:00100000:2.0:1784185004.212187:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11606:x1870853239303040:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 250us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185004.212194:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 214 00010000:00010000:2.0:1784185004.555081:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784185004.619676:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784185004.619685:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784185004.619753:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1784185004.619761:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784185004.622661:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265504640:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784185004.622958:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88247300 going to sleep for 11 seconds 00000100:00100000:3.0:1784185004.648998:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265504640:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784185004.652000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.652227:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239303168 00000100:00100000:3.0:1784185004.652239:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239303168 00000100:00100000:3.0:1784185004.652300:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:3.0:1784185004.652310:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11607:x1870853239303168:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784185004.652368:0:7503:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784185004.652482:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11607:x1870853239303168:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 172us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.652497:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:2.0:1784185004.667357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.667934:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239303296 00000100:00100000:1.0:1784185004.667948:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239303296 00000100:00100000:1.0:1784185004.668068:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:1.0:1784185004.668078:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11607:x1870853239303296:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784185004.668168:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668185:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668197:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668234:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668243:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668249:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668296:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668306:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668312:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185004.668390:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784185004.668395:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784185004.668408:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668419:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668426:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.668433:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669041:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185004.669049:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669058:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669071:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:1.0:1784185004.669083:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185004.669088:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669095:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0e62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669110:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669116:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669122:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669127:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185004.669130:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669135:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669152:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b5f8c4f5200) 00010000:00010000:1.0:1784185004.669154:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185004.669157:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669163:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669179:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669189:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669195:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669200:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185004.669203:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669208:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669214:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784185004.669216:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185004.669219:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.669224:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.669403:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11607:x1870853239303296:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 1323us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185004.669413:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:0.0:1784185004.676999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.677116:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239303552 00000100:00100000:3.0:1784185004.677126:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239303552 00000100:00100000:3.0:1784185004.677681:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:3.0:1784185004.677694:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+60:11607:x1870853239303552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185004.677715:0:7503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185004.677736:0:7503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187197 expref: -99 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.677834:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.677849:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.677884:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185004.677897:0:7503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784185004.678003:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678011:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678017:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678024:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185004.678028:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678035:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678048:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185004.678051:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784185004.678055:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678061:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678100:0:7503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e77 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187197 expref: 62 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678121:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:3.0:1784185004.678124:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784185004.678128:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0e77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187197 expref: 62 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.678267:0:7503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896ec00, rc 0) 00000100:00100000:3.0:1784185004.678631:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+61:11607:x1870853239303552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 938us (1641us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1784185004.678639:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:2.0:1784185004.687311:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.687468:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239303680 00000100:00100000:3.0:1784185004.687478:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239303680 00000100:00100000:3.0:1784185004.687546:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:3.0:1784185004.687565:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:11607:x1870853239303680:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784185004.687600:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784185004.687720:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:11607:x1870853239303680:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 157us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.687728:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:2.0:1784185004.693234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.693377:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239303936 00000100:00100000:1.0:1784185004.693386:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239303936 00000100:00100000:1.0:1784185004.693452:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:1.0:1784185004.693463:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+61:11607:x1870853239303936:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784185004.693483:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185004.693506:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784185004.693535:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631cc00/0x63160f6fbe8b0e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818717b expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.693556:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:1.0:1784185004.693572:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784185004.693588:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818719e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784185004.694009:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1784185004.694207:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.694220:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.694230:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.694288:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0e8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818719e expref: 63 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.694305:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818719e expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.694311:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5200) 00010000:00010000:1.0:1784185004.694314:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784185004.694316:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8a00, rc 0) 00000100:00100000:1.0:1784185004.694420:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+62:11607:x1870853239303936:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 959us (1195us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1784185004.694440:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:0.0:1784185004.705245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.705354:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239304192 00000100:00100000:3.0:1784185004.705366:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239304192 00000100:00100000:3.0:1784185004.705430:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:3.0:1784185004.705441:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+62:11607:x1870853239304192:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784185004.705743:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185004.705771:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b0e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818719e expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.705809:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5200) 00010000:00010000:3.0:1784185004.705822:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784185004.705847:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.705860:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.705869:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.705895:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.705901:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.705907:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.705980:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706043:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706049:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706055:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185004.706059:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706074:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706082:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784185004.706085:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185004.706089:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706094:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ea1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706105:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706110:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706115:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706120:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185004.706123:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706128:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706263:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7921e0b (ffff9b5f93b83e00) 00010000:00010000:3.0:1784185004.706266:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185004.706269:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.706285:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ea8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7921e0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185004.706471:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+61:11607:x1870853239304192:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1030us (1340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784185004.706478:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:3.0:1784185004.709819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.710951:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239304320 00000100:00100000:1.0:1784185004.710964:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239304320 00000100:00100000:1.0:1784185004.711033:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:1.0:1784185004.711043:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+61:11607:x1870853239304320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784185004.711063:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185004.711084:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0eaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871a5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.711120:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.711134:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.711156:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.711255:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 63 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.711274:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.711283:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:1.0:1784185004.711286:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784185004.711290:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9400, rc 0) 00000100:00100000:1.0:1784185004.711389:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+62:11607:x1870853239304320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 347us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185004.711403:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:0.0:1784185004.717624:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.719278:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239304576 00000100:00100000:1.0:1784185004.719293:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239304576 00000100:00100000:1.0:1784185004.719391:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 222 00000100:00100000:1.0:1784185004.719402:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+62:11607:x1870853239304576:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784185004.719498:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.719516:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.719527:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784185004.719768:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1784185004.719779:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402885446093ns, next at 403885443203ns, rc = 0 00000004:00010000:1.0:1784185004.719888:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2848821 reply state 000000008997c60e transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.719898:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784185004.720035:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+64:11607:x1870853239304576:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 634us (2419us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1784185004.720045:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 222 00010000:00010000:2.0:1784185004.724302:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.724321:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.724328:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.724368:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185004.724373:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.724381:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.724398:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:2.0:1784185004.724402:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784185004.724406:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.724412:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9600/0x63160f6fbe8b0ebd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185004.726080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.726182:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239304704 00000100:00100000:1.0:1784185004.726192:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239304704 00000100:00100000:1.0:1784185004.726246:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:1.0:1784185004.726255:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+63:11607:x1870853239304704:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784185004.726278:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185004.726311:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871ac expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.726386:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 64 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.726400:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 64 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.726418:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:1.0:1784185004.726421:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784185004.726425:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8400, rc 0) 00000100:00100000:1.0:1784185004.726494:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+64:11607:x1870853239304704:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 240us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185004.726501:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:0.0:1784185004.732770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.732860:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239304832 00000100:00100000:1.0:1784185004.732869:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239304832 00000100:00100000:1.0:1784185004.732990:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1784185004.733001:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2356:x1870853239304832:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784185004.733302:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2356:x1870853239304832:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 302us (539us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1784185004.733310:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00080000:3.0:1784185004.734815:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784185004.740994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185004.743947:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239305088 00000100:00100000:0.0:1784185004.743965:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239305088 00000100:00100000:0.0:1784185004.744041:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1784185004.744052:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+64:11607:x1870853239305088:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784185004.744320:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+65:11607:x1870853239305088:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 268us (3336us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1784185004.744328:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1784185004.747731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.747978:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239305344 00000100:00100000:3.0:1784185004.747988:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239305344 00000100:00100000:3.0:1784185004.748049:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:3.0:1784185004.748067:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+65:11607:x1870853239305344:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784185004.748188:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+65:11607:x1870853239305344:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 121us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.748195:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:1.0:1784185004.751432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.751837:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239305472 00000100:00100000:3.0:1784185004.751847:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239305472 00000100:00100000:3.0:1784185004.751918:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:3.0:1784185004.751928:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+65:11607:x1870853239305472:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185004.751947:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185004.751968:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0ecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871b3 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.752036:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.752070:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.752082:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185004.752117:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185004.752146:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.752174:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e200/0x63160f6fbe8b0ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871b3 expref: 67 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.752192:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871b3 expref: 66 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.752200:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:3.0:1784185004.752203:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784185004.752205:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e000, rc 0) 00000100:00100000:3.0:1784185004.752423:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+66:11607:x1870853239305472:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 496us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.752430:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:2.0:1784185004.760850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.760947:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239305600 00000100:00100000:3.0:1784185004.760957:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239305600 00000100:00100000:3.0:1784185004.761022:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:3.0:1784185004.761032:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+10:2356:x1870853239305600:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185004.761052:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185004.761094:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871ba expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784185004.761125:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5880ac, blocks: 0x1 00010000:00010000:3.0:1784185004.761158:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1784185004.761162:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185004.761172:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.761190:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.761203:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896e200, rc 0) 00000100:00100000:3.0:1784185004.761273:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+11:2356:x1870853239305600:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 241us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.761281:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1784185004.764715:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.764801:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239305856 00000100:00100000:3.0:1784185004.764812:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239305856 00000100:00100000:3.0:1784185004.764870:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:3.0:1784185004.764890:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+66:11607:x1870853239305856:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784185004.765004:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+66:11607:x1870853239305856:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.765011:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:0.0:1784185004.769531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.769726:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239305984 00000100:00100000:1.0:1784185004.769735:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239305984 00000100:00100000:1.0:1784185004.769788:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:1.0:1784185004.769798:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+11:11607:x1870853239305984:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784185004.769830:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185004.769849:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871c1 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.769889:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.769898:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185004.769903:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185004.769908:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.769959:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.769972:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 12 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.769988:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265504768:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784185004.770081:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e812f4240 going to sleep for 11 seconds 00000100:00100000:2.0:1784185004.777783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.777867:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239306112 00000100:00100000:3.0:1784185004.777886:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239306112 00010000:00010000:3.0:1784185004.777928:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 13 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185004.777993:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:3.0:1784185004.778003:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc172f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2356:x1870853239306112:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185004.778019:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185004.778043:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 13 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.778058:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 13 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.778083:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185004.778088:0:5777:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185004.778096:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 13 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.778106:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 13 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.778158:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 13 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185004.778174:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83365500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5777:1870853265504896:192.168.201.29@tcp:105: 00000100:00100000:3.0:1784185004.778267:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88247300 going to sleep for 11 seconds 00000100:00100000:3.0:1784185004.781104:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83365500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5777:1870853265504896:192.168.201.29@tcp:105: 00010000:00010000:3.0:1784185004.781160:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185004.781220:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc172f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2356:x1870853239306112:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 3218us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.781232:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00010000:00010000:1.0:1784185004.785126:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b0ed9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ba expref: 12 pid: 6590 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.785225:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265504768:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185004.785257:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 11 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.785290:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8600, rc 0) 00000100:00100000:1.0:1784185004.785573:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+11:11607:x1870853239305984:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 15775us (16049us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185004.785582:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:1.0:1784185004.796968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.797172:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239306240 00000100:00100000:3.0:1784185004.797182:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239306240 00002000:00100000:3.0:1784185004.797231:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b5fc1634000 x1870853239306240/t0(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:725/0 lens 504/0 e 0 to 0 dl 1784185015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784185004.797243:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fc1634000 with x1870853239306240 ext(0->12) 00002000:00010000:3.0:1784185004.797249:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fc1634000 00000100:00100000:3.0:1784185004.797281:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1784185004.797291:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+11:2356:x1870853239306240:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784185004.797822:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2356:x1870853239306240:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 529us (860us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1784185004.797832:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00002000:00100000:3.0:1784185004.797838:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b5fc1634000 x1870853239306240/t4294967320(0) o4->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:725/0 lens 504/448 e 0 to 0 dl 1784185015 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784185004.797847:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5fc1634000 with x1870853239306240 ext(0->12) 00002000:00010000:3.0:1784185004.797851:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5fc1634000 00000100:00100000:0.0:1784185004.805321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.805624:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239306368 00000100:00100000:3.0:1784185004.805635:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239306368 00000100:00100000:3.0:1784185004.805697:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:3.0:1784185004.805707:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+66:11607:x1870853239306368:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784185004.881366:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1784185004.881422:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:2.0:1784185004.881495:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1784185004.881507:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5fb7e7b540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1784185004.881511:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f8566cf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fb7e7b300 00000020:00080000:2.0:1784185004.881514:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f8566c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f8121b400 00000020:00080000:2.0:1784185004.881538:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1784185004.881555:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1784185004.881567:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5fb7ddfd80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1784185004.881570:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f87f39b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fb7ddfa80 00000020:00080000:2.0:1784185004.881573:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f87f39300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5fc139dc00 00000020:00080000:2.0:1784185004.881598:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1784185004.881789:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1784185004.881908:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265505024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784185004.881974:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185004.882051:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265505024 00000100:00100000:2.0:1784185004.882059:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265505024 00000100:00100000:2.0:1784185004.882110:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784185004.882118:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265505024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784185004.882415:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1784185004.882866:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5880aa, atime: 0x6a5880ab, ctime: 0x6a5880aa, blocks: 0x1 00010000:00010000:2.0:1784185004.882884:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.882900:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:2.0:1784185004.882905:0:6590:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185004.882912:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.882940:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.882951:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.882958:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.882979:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784185004.883709:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1870853265505024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1589us (1732us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784185004.883718:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1784185004.883748:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784185004.883757:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185004.883763:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.883771:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185004.883775:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.883783:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.883809:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.883816:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b0ee7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.883832:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185004.883833:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185004.883834:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784185004.883866:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fc172c700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784185004.883883:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc172c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265505024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784185004.884352:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265505280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784185004.884394:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185004.884434:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784185004.884440:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265505152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784185004.884461:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185004.884499:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265505280 00000100:00100000:0.0:1784185004.884506:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265505280 00000100:00100000:0.0:1784185004.884549:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265505152 00000100:00100000:0.0:1784185004.884553:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265505152 00000100:00100000:0.0:1784185004.884571:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784185004.884578:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1870853265505280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1784185004.884707:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784185004.884710:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784185004 00002000:00010000:0.0:1784185004.884713:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784185004.884715:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1784185004 -> 1784185004 00002000:00010000:0.0:1784185004.884718:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784185004.884751:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1870853265505280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (357us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1784185004.884758:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784185004.884771:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784185004.884786:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1870853265505152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784185004.884801:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1784185004.884817:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.884835:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.884844:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1784185004.884848:0:6589:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185004.884852:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.884904:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 12 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.884920:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 12 pid: 6588 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185004.884932:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf055f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265505408:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784185004.884984:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249300 going to sleep for 11 seconds 00000100:00080000:0.0:1784185004.884995:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1784185004.885033:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fc1637480/2, rc 0, transno 4294967321 00000100:00100000:0.0:1784185004.885039:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265505280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1784185004.888961:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+20:11607:x1870853239306368:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 83243us (83637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.888989:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:1.0:1784185004.889432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185004.891047:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf055f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1870853265505408:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185004.891080:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185004.892572:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239306496 00000100:00100000:3.0:1784185004.892586:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239306496 00010000:00010000:3.0:1784185004.892647:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 13 pid: 6588 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185004.892789:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1784185004.892800:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+13:2355:x1870853239306496:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185004.892814:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185004.892821:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 13 pid: 6588 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.892835:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 13 pid: 6588 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.892860:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a0ec03/0x63160f6fbe8b0ca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.29@tcp remote: 0x8de9626838187120 expref: 13 pid: 6588 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.892886:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784185004.892891:0:5779:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784185004.892898:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.892908:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.892966:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185004.893021:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+12:2355:x1870853239306496:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 222us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.893029:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00010000:00010000:1.0:1784185004.893095:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.893105:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.893116:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.893134:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.893155:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784185004.893713:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1870853265505152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8925us (9248us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1784185004.893721:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784185004.894049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000004:00080000:0.0:1784185004.894188:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5fc1637800/2, rc 0, transno 4294967322 00000100:00100000:0.0:1784185004.894202:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265505152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784185004.894403:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239306624 00000100:00100000:1.0:1784185004.894410:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239306624 00000100:00100000:1.0:1784185004.894454:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1784185004.894468:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+12:2354:x1870853239306624:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1784185004.899762:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185004.899776:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.899790:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631cc00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185004.899795:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.899807:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.899847:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.899856:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b7d394f/0x63160f6fbe8b0eee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.899887:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185004.899889:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185004.899891:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784185004.962733:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1784185004.962749:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1784185004.962878:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1784185004.962890:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1784185004.962903:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1784185004.963078:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2354:x1870853239306624:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 68605us (69024us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185004.963090:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:2.0:1784185004.968120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185004.968207:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239306880 00000100:00100000:3.0:1784185004.968217:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239306880 00000100:00100000:3.0:1784185004.968279:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:3.0:1784185004.968290:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+20:11607:x1870853239306880:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784185004.968374:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185004.968401:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871b3 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.968419:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:3.0:1784185004.968424:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784185004.968466:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.968481:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185004.968491:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784185004.968739:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0187964 reply state 000000005b954fab transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185004.968761:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784185004.968851:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+21:11607:x1870853239306880:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 562us (740us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1784185004.968858:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:1.0:1784185004.974770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185004.974877:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239307008 00000100:00100000:2.0:1784185004.974888:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239307008 00000100:00100000:2.0:1784185004.974951:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1784185004.974961:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faefa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239307008:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784185004.975222:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784185004.975227:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1784185004 -> 1784185003 00002000:00010000:2.0:1784185004.975229:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784185003 00002000:00010000:2.0:1784185004.975231:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1784185004 -> 1784185003 00002000:00010000:2.0:1784185004.975234:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784185004.975298:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faefa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239307008:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 336us (536us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784185004.975323:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00010000:00010000:0.0:1784185004.975810:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.975820:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.975827:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.975833:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185004.975837:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.975844:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.975858:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:0.0:1784185004.975862:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185004.975866:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.975883:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ec00/0x63160f6fbe8b0ef5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185004.980439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185004.982999:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239307264 00000100:00100000:1.0:1784185004.983018:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239307264 00000100:00100000:1.0:1784185004.983103:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:1.0:1784185004.983112:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+20:11607:x1870853239307264:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784185004.983195:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.983212:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.983220:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.983257:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.983270:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 20 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.983286:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265505536:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784185004.983424:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f982736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784185004.992988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185004.993243:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239307392 00000100:00100000:0.0:1784185004.993253:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239307392 00010000:00010000:0.0:1784185004.993298:0:7492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 21 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185004.993380:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:0.0:1784185004.993390:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2355:x1870853239307392:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185004.993423:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185004.993430:0:7492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 21 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.993455:0:7492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 21 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.993478:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:0.0:1784185004.993484:0:7492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.993494:0:7492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185004.993502:0:7492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185004.993595:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185004.993671:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2355:x1870853239307392:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 281us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185004.993680:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00010000:00010000:1.0:1784185004.994088:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b0eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871a5 expref: 20 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.994105:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1870853265505536:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185004.994162:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994172:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994177:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994209:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994216:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994222:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994229:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185004.994233:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994240:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994249:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:1.0:1784185004.994253:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784185004.994256:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185004.994262:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9800/0x63160f6fbe8b0efc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185004.994323:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb74a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+19:11607:x1870853239307264:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 11211us (13895us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784185004.994360:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:2.0:1784185005.003611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185005.003718:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239307520 00000100:00100000:0.0:1784185005.003728:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239307520 00000100:00100000:0.0:1784185005.003788:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:0.0:1784185005.003798:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239307520:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784185005.003839:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185005.003859:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185005.003897:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784185005.003915:0:10137:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185005.003919:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185005.003955:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185005.003968:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 8 pid: 6589 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185005.003983:0:10137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10137:1870853265505664:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784185005.004069:0:10137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb9249600 going to sleep for 11 seconds 00000100:00100000:2.0:1784185005.008825:0:10137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10137:1870853265505664:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185005.008860:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185005.010902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185005.011273:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239307648 00000100:00100000:3.0:1784185005.011282:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239307648 00010000:00010000:3.0:1784185005.011324:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 9 pid: 6589 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185005.011408:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:3.0:1784185005.011419:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+9:2356:x1870853239307648:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185005.011434:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185005.011460:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 9 pid: 6589 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.011473:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 9 pid: 6589 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.011507:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a9b6357/0x63160f6fbe8b0ee0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de96268381871c1 expref: 9 pid: 6589 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.011524:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784185005.011529:0:5778:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784185005.011535:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.011566:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.011600:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185005.011663:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2356:x1870853239307648:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 246us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185005.011671:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00010000:00010000:2.0:1784185005.011789:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011800:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011823:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011832:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011853:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011861:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ca00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185005.011866:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011887:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011900:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.011906:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e9c5bb/0x63160f6fbe8b0f03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185005.011953:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2353:x1870853239307520:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 8156us (8353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185005.011962:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:3.0:1784185005.019788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185005.019894:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239307904 00000100:00100000:2.0:1784185005.019904:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239307904 00000100:00100000:2.0:1784185005.019977:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 230 00000100:00100000:2.0:1784185005.019986:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+19:11607:x1870853239307904:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784185005.020065:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.020097:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.020109:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.020373:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.020386:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.020395:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.020430:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.020444:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 20 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185005.020457:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265505792:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784185005.020550:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7bcc0 going to sleep for 11 seconds 00000100:00080000:0.0:1784185005.021504:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784185005.025539:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185005.025619:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239308032 00000100:00100000:3.0:1784185005.025629:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239308032 00010000:00010000:3.0:1784185005.025668:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 21 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185005.025712:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:3.0:1784185005.025722:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2355:x1870853239308032:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185005.025737:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185005.025743:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 21 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.025757:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 21 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.025778:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:3.0:1784185005.025784:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.025810:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.025817:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.025837:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185005.025906:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2355:x1870853239308032:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 186us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185005.025915:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00010000:00010000:2.0:1784185005.026397:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b0ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381871ac expref: 20 pid: 5793 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185005.026415:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265505792:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185005.026434:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.026451:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.026457:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784185005.026650:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1784185005.026794:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1784185005.026837:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1784185005.026927:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265505920:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784185005.026978:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185005.027661:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185005.027900:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265505920 00000100:00100000:0.0:1784185005.027908:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265505920 00000100:00100000:0.0:1784185005.027964:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784185005.027973:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1870853265505920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784185005.028081:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1870853265505920:12345-0@lo:1000:mdt00_002.0 Request processed in 109us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185005.028089:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784185005.028238:0:5794:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1784185005.028245:0:5794:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1784185005.028261:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fc1637480, transno 4294967321 00000004:00080000:3.0:1784185005.028276:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fc1637800, transno 4294967322 00000100:00100000:3.0:1784185005.028282:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265505920:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1784185005.028823:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1784185005.028909:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265506048:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784185005.028957:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185005.028995:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7e7bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185005.029808:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265506048 00000100:00100000:0.0:1784185005.029817:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265506048 00000100:00100000:0.0:1784185005.029858:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784185005.029865:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1870853265506048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784185005.030087:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1870853265506048:12345-0@lo:1000:mdt00_002.0 Request processed in 222us (1130us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1784185005.030094:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784185005.030526:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1870853265506048:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1784185005.030568:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030578:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030587:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030605:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185005.030611:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030619:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030636:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f8c4f5f00) 00010000:00010000:3.0:1784185005.030639:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185005.030643:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030651:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f11 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030680:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030687:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030693:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030698:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185005.030701:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030707:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030723:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185005.030726:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185005.030733:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030745:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030755:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.030788:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185005.030802:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265506176:192.168.201.29@tcp:105: 00000100:00100000:3.0:1784185005.030894:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f89fb0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784185005.036380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185005.036459:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239308160 00000100:00100000:0.0:1784185005.036468:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239308160 00000100:00100000:0.0:1784185005.036533:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:0.0:1784185005.036542:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+24:11606:x1870853239308160:12345-192.168.201.29@tcp:49:lfs.0 00000100:00100000:0.0:1784185005.036715:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+24:11606:x1870853239308160:12345-192.168.201.29@tcp:49:lfs.0 Request processed in 173us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185005.036724:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1784185005.036949:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1870853265506176:192.168.201.29@tcp:105: 00010000:00010000:3.0:1784185005.036976:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.036987:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0e54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037079:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037096:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037106:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037116:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037122:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037139:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037145:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158de00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185005.037165:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037173:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037186:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185005.037191:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185005.037194:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037200:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037211:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037216:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037222:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037227:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185005.037230:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037236:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037243:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185005.037245:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784185005.037254:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.037260:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185005.037505:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+23:11607:x1870853239307904:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 17518us (17724us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1784185005.037513:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 230 00000020:00080000:2.0:1784185005.037517:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784185005.037803:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784185005.037809:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784185005.038720:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784185005.038735:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784185005.041453:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185005.041664:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239308416 00000100:00100000:3.0:1784185005.041676:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239308416 00000100:00100000:3.0:1784185005.041733:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:3.0:1784185005.041743:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+23:11607:x1870853239308416:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784185005.042534:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784185005.042634:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1784185005.042683:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.042701:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.042713:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.042722:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.042727:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.042733:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.042749:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784185005.042834:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+25:11607:x1870853239308416:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1091us (1391us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1784185005.042842:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000020:00080000:3.0:1784185005.042847:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784185005.044260:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185005.044275:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185005.044286:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185005.044291:0:7491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185005.044300:0:7491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185005.044320:0:7491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b5f93b83200) 00010000:00010000:1.0:1784185005.044323:0:7491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784185005.044329:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185005.044381:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896e000/0x63160f6fbe8b0f1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185005.044407:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185005.044409:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185005.044411:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185005.047311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185005.047533:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239308672 00000100:00100000:3.0:1784185005.047544:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239308672 00000100:00100000:3.0:1784185005.047624:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:3.0:1784185005.047633:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+25:11606:x1870853239308672:12345-192.168.201.29@tcp:58:lfs.0 00000040:00080000:3.0:1784185005.047919:0:7503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1784185005.048010:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+25:11606:x1870853239308672:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 377us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185005.048018:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:1.0:1784185005.120197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185005.120370:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239308800 00000100:00100000:2.0:1784185005.120380:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239308800 00000100:00100000:2.0:1784185005.120448:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 232 00000100:00100000:2.0:1784185005.120458:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+25:11609:x1870853239308800:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185005.120485:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185005.120508:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871c8 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120576:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120591:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120603:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120616:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120623:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120640:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120942:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120953:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 26 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120962:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.120999:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 26 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.121013:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 26 pid: 5794 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185005.121027:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265506304:192.168.201.29@tcp:104: 00000100:00100000:2.0:1784185005.121120:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e82a8ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1784185005.134299:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1870853265506304:192.168.201.29@tcp:104: 00010000:00010000:2.0:1784185005.134366:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185005.137885:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185005.138191:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239309056 00000100:00100000:3.0:1784185005.138202:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239309056 00000100:00100000:3.0:1784185005.138263:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:3.0:1784185005.138273:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+27:5570:x1870853239309056:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784185005.138561:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+28:5570:x1870853239309056:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 289us (695us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1784185005.138570:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1784185005.145792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185005.145899:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239309184 00000100:00100000:3.0:1784185005.145910:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239309184 00010000:00010000:3.0:1784185005.145954:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 28 pid: 5794 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185005.145998:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1784185005.146008:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+28:2355:x1870853239309184:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185005.146026:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185005.146034:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 28 pid: 5794 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.146048:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 28 pid: 5794 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.146094:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c600/0x63160f6fbe8b0e46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187189 expref: 28 pid: 5794 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.146112:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185005.146118:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.146129:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.146252:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185005.146292:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784185005.146448:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146457:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185005.146510:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784185005.146515:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185005.146536:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146549:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146559:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146566:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146573:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146579:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158de00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185005.146584:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146592:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146602:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:2.0:1784185005.146605:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185005.146608:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146614:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158de00/0x63160f6fbe8b0f2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146636:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146643:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146648:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146652:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185005.146655:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146660:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146668:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b5f988b7200) 00010000:00010000:2.0:1784185005.146671:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185005.146673:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146678:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c000/0x63160f6fbe8b0f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146711:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d200/0x63160f6fbe8b0f26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c8 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146725:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c8 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185005.146744:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185005.146746:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784185005.146748:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158c400, rc 0) 00000100:00100000:2.0:1784185005.146797:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+27:11609:x1870853239308800:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 26341us (26609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185005.146804:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 232 00000100:00100000:3.0:1784185005.147056:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+26:2355:x1870853239309184:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 1048us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185005.147065:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00010000:00010000:2.0:1784185005.581431:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185005.771145:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265506816:0@lo:400:kworker.0 00000100:00100000:0.0:1784185005.771222:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185005.771307:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784185005.771318:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265506688:0@lo:400:kworker.0 00000100:00100000:0.0:1784185005.771386:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185005.771744:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265506432:0@lo:400:kworker.0 00000100:00100000:2.0:1784185005.771804:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185005.771863:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265506944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784185005.771906:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185005.771937:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784185005.771949:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265506560:0@lo:400:kworker.0 00000100:00100000:2.0:1784185005.771983:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185005.772031:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265506944 00000100:00100000:2.0:1784185005.772039:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265506944 00000100:00100000:2.0:1784185005.772109:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784185005.772118:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265506944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784185005.772144:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1784185005.772188:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265506944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185005.772194:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784185005.772241:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265506944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784185005.772433:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265506432 00000100:00100000:0.0:1784185005.772440:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265506432 00000100:00100000:0.0:1784185005.772638:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1784185005.772654:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265506432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185005.773078:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265506432:12345-0@lo:400:kworker.0 Request processed in 426us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185005.773116:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1784185005.773160:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265506816 00000100:00100000:0.0:1784185005.773165:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265506816 00000100:00100000:0.0:1784185005.773200:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265506688 00000100:00100000:0.0:1784185005.773204:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265506688 00000100:00100000:0.0:1784185005.773219:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265506560 00000100:00100000:0.0:1784185005.773222:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265506560 00000100:00100000:0.0:1784185005.773234:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784185005.775972:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265506432:0@lo:400:kworker.0 00000100:00100000:0.0:1784185005.776090:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265506816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185005.776173:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265506816:12345-0@lo:400:kworker.0 Request processed in 89us (4950us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185005.780644:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784185005.780674:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265506688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185005.780773:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265506688:12345-0@lo:400:kworker.0 Request processed in 114us (9385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185005.780780:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784185005.780815:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784185005.780821:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265506560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185005.780879:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265506560:12345-0@lo:400:kworker.0 Request processed in 58us (8897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185005.780886:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784185005.789020:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265506560:0@lo:400:kworker.0 00000100:00100000:0.0:1784185005.789355:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1784185005.789391:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185005.789418:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265506688:0@lo:400:kworker.0 00000100:00100000:0.0:1784185005.789431:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265506816:0@lo:400:kworker.0 00000040:00080000:3.0:1784185006.099188:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784185006.099197:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784185006.099238:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1784185006.099244:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784185006.100737:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265507072:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784185006.100895:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f82ad6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784185006.130823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185006.131243:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239309312 00000100:00100000:1.0:1784185006.131254:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239309312 00000100:00100000:1.0:1784185006.131327:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:1.0:1784185006.131366:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+27:11620:x1870853239309312:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784185006.131405:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784185006.131520:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+27:11620:x1870853239309312:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 155us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185006.131528:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:3.0:1784185006.134463:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11544:1870853265507072:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784185006.141280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185006.141496:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239309568 00000100:00100000:1.0:1784185006.141506:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239309568 00000100:00100000:1.0:1784185006.141559:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:1.0:1784185006.141569:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+26:11620:x1870853239309568:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784185006.141590:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185006.141611:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0f42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871cf expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185006.141725:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185006.141740:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185006.141753:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185006.141766:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784185006.141969:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9a00/0x63160f6fbe8b0f42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871cf expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185006.141991:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871cf expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185006.142001:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:1.0:1784185006.142004:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784185006.142008:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8800, rc 0) 00000100:00100000:1.0:1784185006.142065:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+28:11620:x1870853239309568:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 498us (794us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1784185006.142073:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:1.0:1784185006.152570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185006.152695:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239309824 00000100:00100000:3.0:1784185006.152705:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239309824 00000100:00100000:3.0:1784185006.152774:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 235 00000100:00100000:3.0:1784185006.152783:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+28:11620:x1870853239309824:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784185006.152875:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.152892:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.152903:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.153092:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.153100:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.153220:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.153229:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185006.153233:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.153241:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.153254:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185006.153257:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784185006.153262:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.153279:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185006.153559:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+29:11620:x1870853239309824:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 775us (999us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1784185006.153569:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 235 00000040:00080000:1.0:1784185006.154221:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784185006.154227:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784185006.154770:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784185006.154782:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784185006.159301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185006.168715:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239310080 00000100:00100000:2.0:1784185006.168732:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239310080 00000100:00100000:2.0:1784185006.168800:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1784185006.168811:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+29:11620:x1870853239310080:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784185006.169070:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+30:11620:x1870853239310080:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 260us (9777us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1784185006.169078:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:1.0:1784185006.169957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185006.170603:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239310208 00000100:00100000:2.0:1784185006.170612:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239310208 00000100:00100000:2.0:1784185006.170665:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1784185006.170673:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f91f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+30:2356:x1870853239310208:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784185006.170688:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185006.170713:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8800/0x63160f6fbe8b0f49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871cf expref: 30 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185006.170729:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185006.170734:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185006.170771:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f91f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+29:2356:x1870853239310208:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 99us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185006.170777:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000040:00080000:3.0:1784185006.184072:0:12375:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784185006.184081:0:12375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784185006.184248:0:12375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1784185006.184254:0:12375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1784185006.381475:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1784185006.381497:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1784185006.381506:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1784185006.467137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185006.467511:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239310464 00000100:00100000:2.0:1784185006.467523:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239310464 00000100:00100000:2.0:1784185006.467584:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:2.0:1784185006.467595:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+29:11633:x1870853239310464:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185006.467638:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185006.467660:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b0f5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871d6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185006.467760:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0f65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185006.467775:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185006.467788:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185006.467799:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784185006.467940:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ce00/0x63160f6fbe8b0f5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871d6 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185006.467959:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871d6 expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185006.467967:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:2.0:1784185006.467970:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784185006.467974:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158da00, rc 0) 00000100:00100000:2.0:1784185006.468037:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:11633:x1870853239310464:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 443us (909us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784185006.468044:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:3.0:1784185006.473240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185006.473278:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239310592 00000100:00100000:3.0:1784185006.473288:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239310592 00000100:00100000:3.0:1784185006.473353:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 237 00000100:00100000:3.0:1784185006.473362:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+31:11633:x1870853239310592:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1784185006.473424:0:7503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473439:0:7503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473453:0:7503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473480:0:7503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473487:0:7503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473502:0:7503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473507:0:7503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185006.473510:0:7503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473515:0:7503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473527:0:7503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185006.473530:0:7503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784185006.473534:0:7503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185006.473540:0:7503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ea00/0x63160f6fbe8b0f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185006.473605:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+31:11633:x1870853239310592:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 245us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185006.473611:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 237 00010000:00010000:2.0:1784185006.605544:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185006.614147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185006.614312:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239310720 00000100:00100000:1.0:1784185006.614323:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239310720 00000100:00100000:1.0:1784185006.614428:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:1.0:1784185006.614440:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2353:x1870853239310720:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1784185006.614461:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1784185006.614559:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784185006.614640:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000200dd6d9/0x63160f6fbe8b0f7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871dd expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784185006.614668:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a5880ab, atime: 0x6a5880ab, ctime: 0x6a5880ab, blocks: 0xb 00010000:00010000:1.0:1784185006.614687:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784185006.614692:0:6588:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185006.614703:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000200dd6d9/0x63160f6fbe8b0f7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871dd expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185006.614720:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000200dd6d9/0x63160f6fbe8b0f7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871dd expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185006.614734:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8200, rc 0) 00000100:00100000:1.0:1784185006.614794:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239310720:12345-192.168.201.29@tcp:101:cat.0 Request processed in 357us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185006.614802:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:3.0:1784185006.629477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185006.629664:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239310848 00000100:00100000:2.0:1784185006.629690:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239310848 00002000:00100000:2.0:1784185006.629747:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b5f83365c00 x1870853239310848/t0(0) o3->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:727/0 lens 488/0 e 0 to 0 dl 1784185017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784185006.629760:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f83365c00 with x1870853239310848 ext(0->4095) 00002000:00010000:2.0:1784185006.629766:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5f83365c00 00000100:00100000:2.0:1784185006.629804:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1784185006.629815:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239310848:12345-192.168.201.29@tcp:3:cat.0 00000100:00100000:2.0:1784185006.630092:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239310848:12345-192.168.201.29@tcp:3:cat.0 Request processed in 276us (634us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784185006.630101:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00002000:00100000:2.0:1784185006.630109:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b5f83365c00 x1870853239310848/t0(0) o3->89741aef-63f5-4e1f-9ce7-defb19b62903@192.168.201.29@tcp:727/0 lens 488/4536 e 0 to 0 dl 1784185017 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784185006.630116:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b5f83365c00 with x1870853239310848 ext(0->4095) 00002000:00010000:2.0:1784185006.630121:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b5f83365c00 00000100:00100000:3.0:1784185006.674557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185006.674662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185006.674701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185006.674728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185006.674754:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185006.674813:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239310976 00000100:00100000:0.0:1784185006.674822:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239310976 00000100:00100000:0.0:1784185006.674882:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 305 00000100:00100000:0.0:1784185006.674893:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239310976:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185006.674966:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239310976:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 75us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185006.674975:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 305 00000100:00100000:0.0:1784185006.675037:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239311360 00000100:00100000:0.0:1784185006.675041:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239311360 00000100:00100000:0.0:1784185006.675064:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239311232 00000100:00100000:0.0:1784185006.675067:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239311232 00000100:00100000:0.0:1784185006.675095:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1784185006.675102:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239311360:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185006.675129:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+8:2353:x1870853239311360:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185006.675135:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1784185006.675162:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1784185006.675168:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239311232:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185006.675208:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239311232:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 40us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185006.675215:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00080000:0.0:1784185006.675231:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784185006.692094:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239311104 00000100:00100000:2.0:1784185006.692110:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239311104 00000100:00100000:2.0:1784185006.692205:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:2.0:1784185006.692218:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:2353:x1870853239311104:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185006.692319:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+31:2353:x1870853239311104:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 104us (17770us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185006.692326:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:2.0:1784185006.692372:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239311488 00000100:00100000:2.0:1784185006.692376:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239311488 00000100:00100000:2.0:1784185006.692421:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:2.0:1784185006.692428:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239311488:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:1.0:1784185006.692770:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784185006.693000:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2353:x1870853239311488:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 570us (18243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185006.693007:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:2.0:1784185007.307016:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265507200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784185007.307118:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185007.307253:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265507200 00000100:00100000:0.0:1784185007.307263:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265507200 00000100:00100000:0.0:1784185007.307369:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784185007.307382:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265507200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784185007.307424:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784185007.307822:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784185007.311919:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265507200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4527us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185007.311939:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784185007.312231:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1784185007.312240:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1784185007.312264:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5fc172c700, transno 4294967310 00000100:00100000:2.0:1784185007.312393:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265507200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784185007.630870:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784185008.203542:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784185008.203554:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784185008.203590:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784185008.203601:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784185008.663290:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185009.676913:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784185009.984119:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:3.0:1784185009.984146:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1784185009.984167:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1784185009.984205:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b5f882476c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1784185009.984210:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f87f39a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f88247540 00000020:00080000:3.0:1784185009.984214:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b5f87f39600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b5f88ccd400 00000020:00080000:0.0:1784185009.984241:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1784185009.984458:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1784185010.432076:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1784185010.432095:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1784185010.699518:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185010.892670:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784185010.892696:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265507328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784185010.892766:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185010.892988:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265507328 00000100:00100000:3.0:1784185010.892997:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265507328 00000100:00100000:3.0:1784185010.893060:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784185010.893070:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265507328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784185010.893106:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784185010.893155:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265507328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185010.893162:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784185010.893200:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1784185010.893205:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1784185010.893229:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265507328:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784185010.893359:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784185010.894376:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265507584:0@lo:400:kworker.0 00000100:00100000:1.0:1784185010.894475:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185010.894504:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784185010.894510:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265507712:0@lo:400:kworker.0 00000100:00100000:1.0:1784185010.894531:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185010.894736:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265507840:0@lo:400:kworker.0 00000100:00100000:0.0:1784185010.894785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185010.894816:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784185010.894822:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265507456:0@lo:400:kworker.0 00000100:00100000:0.0:1784185010.894849:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185010.894869:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265507968:0@lo:400:kworker.0 00000100:00100000:0.0:1784185010.894888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185010.894915:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265507584 00000100:00100000:0.0:1784185010.894922:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265507584 00000100:00100000:0.0:1784185010.894956:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265507712 00000100:00100000:0.0:1784185010.894971:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265507712 00000100:00100000:0.0:1784185010.894993:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265507968 00000100:00100000:0.0:1784185010.894995:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265507968 00000100:00100000:0.0:1784185010.895007:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784185010.895014:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265507584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185010.895060:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265507584:12345-0@lo:400:kworker.0 Request processed in 46us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185010.895067:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784185010.895084:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784185010.895091:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265507712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185010.895117:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265507712:12345-0@lo:400:kworker.0 Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185010.895123:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784185010.895134:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784185010.895140:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265507968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185010.895168:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265507968:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185010.895174:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784185010.895210:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265507968:0@lo:400:kworker.0 00000100:00080000:0.0:1784185010.895231:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185010.895246:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265507712:0@lo:400:kworker.0 00000100:00100000:0.0:1784185010.895255:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265507584:0@lo:400:kworker.0 00000100:00100000:1.0:1784185010.895568:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265507840 00000100:00100000:1.0:1784185010.895573:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265507840 00000100:00100000:1.0:1784185010.895623:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784185010.895640:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265507840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185010.895691:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265507840:12345-0@lo:400:kworker.0 Request processed in 52us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185010.895698:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784185010.895719:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265507456 00000100:00100000:1.0:1784185010.895722:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265507456 00000100:00100000:1.0:1784185010.895742:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1784185010.895748:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265507456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185010.895787:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265507456:12345-0@lo:400:kworker.0 Request processed in 39us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185010.895794:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1784185010.895922:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265507456:0@lo:400:kworker.0 00000100:00100000:3.0:1784185010.895934:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265507840:0@lo:400:kworker.0 00000100:00080000:0.0:1784185010.896756:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784185011.726133:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185011.805240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185011.805281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185011.805311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185011.805360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185011.805406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185011.805438:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239311872 00000100:00100000:3.0:1784185011.805448:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239311872 00000100:00100000:3.0:1784185011.805509:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239312000 00000100:00100000:3.0:1784185011.805512:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239312000 00000100:00100000:3.0:1784185011.805536:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1784185011.805546:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239311872:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185011.805614:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2356:x1870853239311872:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 70us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185011.805622:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1784185011.805638:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:3.0:1784185011.805646:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239312000:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185011.805673:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2356:x1870853239312000:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185011.805679:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:3.0:1784185011.805696:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239312128 00000100:00100000:3.0:1784185011.805700:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239312128 00000100:00100000:3.0:1784185011.805725:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239311744 00000100:00100000:3.0:1784185011.805727:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239311744 00000100:00100000:3.0:1784185011.805745:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:3.0:1784185011.805751:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239312128:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185011.805949:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2356:x1870853239312128:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 198us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185011.805957:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:3.0:1784185011.805969:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00100000:3.0:1784185011.805975:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2356:x1870853239311744:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185011.806000:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2356:x1870853239311744:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185011.806017:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00080000:3.0:1784185011.806042:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784185011.806046:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784185011.806048:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784185011.806278:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239311616 00000100:00100000:0.0:1784185011.806283:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239311616 00000100:00100000:0.0:1784185011.806317:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 307 00000100:00100000:0.0:1784185011.806324:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239311616:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185011.806382:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2356:x1870853239311616:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 58us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185011.806388:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 307 00000100:00100000:1.0:1784185012.427373:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265508096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784185012.427445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185012.427693:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508096 00000100:00100000:2.0:1784185012.427701:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508096 00000100:00100000:2.0:1784185012.427794:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784185012.427804:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265508096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784185012.427839:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784185012.427890:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265508096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185012.427898:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784185012.427942:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265508096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784185012.428039:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784185012.465465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185012.467503:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239312256 00000100:00100000:0.0:1784185012.467519:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239312256 00000100:00100000:0.0:1784185012.467602:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 238 00000100:00100000:0.0:1784185012.467612:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11286:x1870853239312256:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784185012.468048:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11286:x1870853239312256:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 435us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185012.468057:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 238 00000100:00100000:0.0:1784185012.477848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185012.477959:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239312512 00000100:00100000:2.0:1784185012.477969:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239312512 00000100:00100000:2.0:1784185012.478036:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:2.0:1784185012.478046:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:11286:x1870853239312512:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784185012.479997:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:11286:x1870853239312512:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1942us (2149us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1784185012.480010:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1784185012.711500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185012.711784:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239312640 00000100:00100000:2.0:1784185012.711798:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239312640 00000100:00100000:2.0:1784185012.711887:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 239 00000100:00100000:2.0:1784185012.711899:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:12084:x1870853239312640:12345-192.168.201.29@tcp:101:lsof.0 00010000:00010000:2.0:1784185012.711927:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185012.712144:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381871e4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185012.712860:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0f88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185012.712879:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185012.712894:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185012.714894:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784185012.716053:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185012.716250:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185012.716292:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d400/0x63160f6fbe8b0f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871e4 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185012.716315:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0f88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871e4 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185012.716325:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:3.0:1784185012.716328:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784185012.716375:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f800, rc 0) 00000100:00100000:3.0:1784185012.716468:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f84464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:12084:x1870853239312640:12345-192.168.201.29@tcp:101:lsof.0 Request processed in 4569us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185012.716478:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 239 00010000:00010000:2.0:1784185012.747023:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185013.770802:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185014.794972:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784185015.041486:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1784185015.041559:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1784185015.041573:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1784185015.041755:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:2.0:1784185015.818722:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185016.010964:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265508352:0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185016.011148:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265508864:0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185016.011215:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784185016.011221:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265508480:0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011245:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185016.011288:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508864 00000100:00100000:3.0:1784185016.011297:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508864 00000100:00100000:3.0:1784185016.011403:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784185016.011413:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265508864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011474:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265508864:12345-0@lo:400:kworker.0 Request processed in 63us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185016.011482:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1784185016.011505:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784185016.011523:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508352 00000100:00100000:3.0:1784185016.011526:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508352 00000100:00100000:3.0:1784185016.011552:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508480 00000100:00100000:3.0:1784185016.011555:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508480 00000100:00100000:3.0:1784185016.011577:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784185016.011584:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265508352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011618:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265508352:12345-0@lo:400:kworker.0 Request processed in 34us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185016.011642:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784185016.011654:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784185016.011660:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265508480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011699:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265508480:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185016.011706:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1784185016.011719:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185016.011760:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265508480:0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011773:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265508352:0@lo:400:kworker.0 00000100:00100000:3.0:1784185016.011782:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265508864:0@lo:400:kworker.0 00000100:00100000:1.0:1784185016.012256:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265508608:0@lo:400:kworker.0 00000100:00100000:1.0:1784185016.012306:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185016.012367:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784185016.012374:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265508224:0@lo:400:kworker.0 00000100:00100000:1.0:1784185016.012421:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185016.012449:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb89c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265508736:0@lo:400:kworker.0 00000100:00100000:1.0:1784185016.012472:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185016.012506:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508224 00000100:00100000:1.0:1784185016.012512:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508224 00000100:00100000:1.0:1784185016.012545:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1784185016.012553:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265508224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185016.012591:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f82ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265508224:12345-0@lo:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185016.012598:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1784185016.012631:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508736 00000100:00100000:1.0:1784185016.012634:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508736 00000100:00100000:1.0:1784185016.012666:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784185016.012672:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265508736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185016.012712:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265508736:12345-0@lo:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185016.012718:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1784185016.012732:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784185016.012756:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265508224:0@lo:400:kworker.0 00000100:00100000:1.0:1784185016.012955:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb89c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265508736:0@lo:400:kworker.0 00000100:00100000:0.0:1784185016.013786:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265508992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784185016.013847:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185016.013982:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508992 00000100:00100000:2.0:1784185016.013990:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508992 00000100:00100000:2.0:1784185016.014046:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784185016.014057:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265508992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784185016.014099:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784185016.014147:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265508992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185016.014155:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784185016.014287:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265508608 00000100:00100000:3.0:1784185016.014293:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265508608 00000100:00100000:3.0:1784185016.014379:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784185016.014387:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265508608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185016.014655:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265508992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784185016.015032:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265508608:12345-0@lo:400:kworker.0 Request processed in 647us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185016.015039:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1784185016.015101:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784185016.015158:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265508608:0@lo:400:kworker.0 00010000:00010000:3.0:1784185016.845098:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185016.913814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185016.913858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185016.913887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185016.913921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185016.914112:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313024 00000100:00100000:1.0:1784185016.914126:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313024 00000100:00100000:1.0:1784185016.914208:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:1.0:1784185016.914220:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239313024:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784185016.914326:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2353:x1870853239313024:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 108us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185016.914355:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:1.0:1784185016.914391:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239312896 00000100:00100000:1.0:1784185016.914395:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239312896 00000100:00100000:1.0:1784185016.914427:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313280 00000100:00100000:1.0:1784185016.914430:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313280 00000100:00100000:1.0:1784185016.914454:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:1.0:1784185016.914463:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2353:x1870853239312896:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784185016.914518:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2353:x1870853239312896:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 57us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185016.914524:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:1.0:1784185016.914537:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 183 00000100:00100000:1.0:1784185016.914544:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb89c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2353:x1870853239313280:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784185016.914568:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb89c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2353:x1870853239313280:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185016.914574:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 183 00000100:00080000:1.0:1784185016.914596:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784185016.914613:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784185016.915194:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239312768 00000100:00100000:3.0:1784185016.915200:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239312768 00000100:00100000:3.0:1784185016.915241:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 309 00000100:00100000:3.0:1784185016.915257:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239312768:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185016.915854:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2353:x1870853239312768:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 594us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185016.915863:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 309 00000100:00100000:3.0:1784185016.916887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185016.916988:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313152 00000100:00100000:1.0:1784185016.916997:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313152 00000100:00100000:1.0:1784185016.917064:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:1.0:1784185016.917074:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2353:x1870853239313152:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784185016.917144:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2353:x1870853239313152:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185016.917152:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00080000:2.0:1784185016.917381:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784185017.548567:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265509120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784185017.548684:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185017.548845:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265509120 00000100:00100000:0.0:1784185017.548857:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265509120 00000100:00100000:0.0:1784185017.548997:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784185017.549010:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265509120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784185017.549062:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185017.549119:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265509120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185017.549135:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784185017.549372:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265509120:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1784185017.580187:0:12579:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:56:55 (1784185015) 00010000:00010000:2.0:1784185017.870724:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784185018.445829:0:11544:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784185018.445842:0:11544:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784185018.446452:0:11544:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1784185018.446467:0:11544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784185018.891058:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185019.916307:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185020.939434:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185021.134741:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265509248:0@lo:400:kworker.0 00000100:00100000:3.0:1784185021.134861:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185021.134949:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265509760:0@lo:400:kworker.0 00000100:00100000:3.0:1784185021.134982:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185021.135022:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784185021.135030:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265509632:0@lo:400:kworker.0 00000100:00100000:3.0:1784185021.135058:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185021.136446:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265509504:0@lo:400:kworker.0 00000100:00100000:0.0:1784185021.136670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185021.136731:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784185021.136739:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265509376:0@lo:400:kworker.0 00000100:00100000:0.0:1784185021.136767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185021.136786:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265509888:0@lo:400:kworker.0 00000100:00100000:0.0:1784185021.136810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185021.136857:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265509632 00000100:00100000:0.0:1784185021.136867:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265509632 00000100:00100000:0.0:1784185021.136929:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265509888 00000100:00100000:0.0:1784185021.136932:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265509888 00000100:00100000:0.0:1784185021.136958:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784185021.136969:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265509632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185021.137035:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265509632:12345-0@lo:400:kworker.0 Request processed in 69us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185021.137043:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784185021.137061:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784185021.137067:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265509888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185021.137099:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265509888:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185021.137105:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784185021.137252:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265509760 00000100:00100000:3.0:1784185021.137257:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265509760 00000100:00100000:3.0:1784185021.137293:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265509504 00000100:00100000:3.0:1784185021.137296:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265509504 00000100:00100000:3.0:1784185021.137309:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265509376 00000100:00100000:3.0:1784185021.137312:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265509376 00000100:00100000:3.0:1784185021.137323:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784185021.137817:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784185021.137832:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265510016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784185021.137878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185021.137924:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784185021.137934:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265509504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185021.137972:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265509504:12345-0@lo:400:kworker.0 Request processed in 40us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185021.137978:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784185021.137997:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784185021.138003:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265509376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185021.138030:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265509376:12345-0@lo:400:kworker.0 Request processed in 27us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185021.138036:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784185021.138069:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510016 00000100:00100000:1.0:1784185021.138091:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510016 00000100:00100000:2.0:1784185021.138241:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265509248 00000100:00100000:2.0:1784185021.138246:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265509248 00000100:00100000:2.0:1784185021.138278:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784185021.138285:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265509248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185021.138322:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3316:x1870853265509248:12345-0@lo:400:kworker.0 Request processed in 38us (3462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185021.138329:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:2.0:1784185021.138398:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784185021.138404:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784185021.138406:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784185021.138641:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265509632:0@lo:400:kworker.0 00000100:00100000:2.0:1784185021.138655:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265509248:0@lo:400:kworker.0 00000100:00100000:2.0:1784185021.138714:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784185021.138722:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265510016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784185021.138760:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784185021.138802:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265510016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185021.138808:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784185021.138852:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265510016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784185021.139062:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265509760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185021.139118:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265509760:12345-0@lo:400:kworker.0 Request processed in 1788us (4134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185021.140265:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784185021.142933:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb8c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265509376:0@lo:400:kworker.0 00000100:00100000:0.0:1784185021.142963:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265509888:0@lo:400:kworker.0 00000100:00100000:0.0:1784185021.143007:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265509504:0@lo:400:kworker.0 00000100:00100000:2.0:1784185021.143173:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265509760:0@lo:400:kworker.0 00010000:00010000:2.0:1784185021.962710:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185022.029906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185022.029956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185022.030012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185022.030045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185022.030068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185022.030164:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313408 00000100:00100000:1.0:1784185022.030175:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313408 00000100:00100000:1.0:1784185022.030232:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 311 00000100:00100000:1.0:1784185022.030242:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239313408:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784185022.030311:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2354:x1870853239313408:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 70us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185022.030318:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 311 00000100:00100000:1.0:1784185022.030382:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313920 00000100:00100000:1.0:1784185022.030385:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313920 00000100:00100000:1.0:1784185022.030431:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313536 00000100:00100000:1.0:1784185022.030434:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313536 00000100:00100000:1.0:1784185022.030452:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00100000:1.0:1784185022.030458:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2354:x1870853239313920:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784185022.030490:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2354:x1870853239313920:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185022.030498:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00100000:1.0:1784185022.030527:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00100000:1.0:1784185022.030533:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2354:x1870853239313536:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1784185022.030559:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+18:2354:x1870853239313536:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185022.030564:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00080000:1.0:1784185022.030580:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185022.030883:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313664 00000100:00100000:0.0:1784185022.030888:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313664 00000100:00100000:0.0:1784185022.030930:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239313792 00000100:00100000:0.0:1784185022.030934:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239313792 00000100:00100000:0.0:1784185022.030954:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:0.0:1784185022.030961:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239313664:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185022.030987:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2354:x1870853239313664:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185022.030991:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:0.0:1784185022.031003:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:0.0:1784185022.031008:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2354:x1870853239313792:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185022.031030:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2354:x1870853239313792:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185022.031036:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00080000:1.0:1784185022.031396:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784185022.031399:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784185022.064563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185022.064826:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239314176 00000100:00100000:2.0:1784185022.064836:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239314176 00000100:00100000:2.0:1784185022.064898:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:2.0:1784185022.064908:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+18:12306:x1870853239314176:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:2.0:1784185022.065485:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:12306:x1870853239314176:12345-192.168.201.29@tcp:35:umount.0 Request processed in 577us (929us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1784185022.065493:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:3.0:1784185022.070545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185022.070866:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239314432 00000100:00100000:2.0:1784185022.070876:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239314432 00000100:00100000:2.0:1784185022.070941:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:2.0:1784185022.070952:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+19:12306:x1870853239314432:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:2.0:1784185022.071300:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:12306:x1870853239314432:12345-192.168.201.29@tcp:35:umount.0 Request processed in 349us (763us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1784185022.071309:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:3.0:1784185022.077756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185022.079876:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239314688 00000100:00100000:2.0:1784185022.079888:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239314688 00000100:00100000:2.0:1784185022.079953:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:2.0:1784185022.079965:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fa051dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+20:12306:x1870853239314688:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:2.0:1784185022.082092:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fa051dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89741aef-63f5-4e1f-9ce7-defb19b62903+21:12306:x1870853239314688:12345-192.168.201.29@tcp:35:umount.0 Request processed in 2120us (4341us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1784185022.082105:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1784185022.087837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185022.088137:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239314944 00000100:00100000:0.0:1784185022.088147:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239314944 00000100:00100000:0.0:1784185022.088217:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:0.0:1784185022.088226:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+21:12306:x1870853239314944:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:0.0:1784185022.088620:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+22:12306:x1870853239314944:12345-192.168.201.29@tcp:35:umount.0 Request processed in 392us (790us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1784185022.088628:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1784185022.099681:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185022.099745:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185022.099782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185022.099829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185022.099878:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239315712 00000100:00100000:3.0:1784185022.099888:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239315712 00000100:00100000:3.0:1784185022.099944:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:3.0:1784185022.099955:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+7:2352:x1870853239315712:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:3.0:1784185022.099988:0:10137:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8b0540 00000020:00010000:3.0:1784185022.099996:0:10137:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b5fb506c000: total 0 00000100:00080000:3.0:1784185022.100001:0:10137:0:(import.c:65:import_set_state_nolock()) ffff9b5fa067c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784185022.100322:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239315072 00000100:00100000:0.0:1784185022.100328:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239315072 00000100:00100000:0.0:1784185022.100394:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239315200 00000100:00100000:0.0:1784185022.100405:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239315200 00000100:00100000:0.0:1784185022.100430:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239315456 00000100:00100000:0.0:1784185022.100433:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239315456 00000100:00100000:0.0:1784185022.100449:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1784185022.100455:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+15:2355:x1870853239315072:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185022.100466:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185022.100485:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8b0000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d6f expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185022.100503:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185022.100553:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+14:2355:x1870853239315072:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 97us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185022.100560:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1784185022.100578:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1784185022.100596:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+13:2355:x1870853239315200:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185022.100604:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185022.100613:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971400/0x63160f6fbe8aff66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d37 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185022.100622:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185022.100640:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:2355:x1870853239315200:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 55us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185022.100646:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1784185022.100660:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1784185022.100666:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:2353:x1870853239315456:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185022.100673:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185022.100682:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971200/0x63160f6fbe8b01ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e3a expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185022.100696:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185022.100713:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2353:x1870853239315456:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 48us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185022.100719:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000020:00010000:0.0:1784185022.104163:0:7491:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b5fb506c000: total 0 00010000:00010000:0.0:1784185022.104301:0:7491:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b5fb506c000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1784185022.104389:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000200dd6d9/0x63160f6fbe8b0f7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871dd expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185022.104520:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000379aca4c/0x63160f6fbe8b08dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818700f expref: 5 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185022.104539:0:7491:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b5fb506c000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1784185022.104552:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185022.104554:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185022.104556:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1784185022.107985:0:10137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1784185022.116598:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+2:2352:x1870853239315712:12345-192.168.201.29@tcp:9:umount.0 Request processed in 16624us (16747us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185022.116614:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:3.0:1784185022.121394:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185022.121501:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239315840 00000100:00100000:1.0:1784185022.121511:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239315840 00000100:00100000:1.0:1784185022.121579:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:1.0:1784185022.121598:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+5:2352:x1870853239315840:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:1.0:1784185022.121629:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8b02d8 00000100:00080000:1.0:1784185022.121638:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9b5f8338d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784185022.121684:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1784185022.121959:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89741aef-63f5-4e1f-9ce7-defb19b62903+2:2352:x1870853239315840:12345-192.168.201.29@tcp:9:umount.0 Request processed in 362us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185022.121967:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00010000:00010000:0.0:1784185022.122027:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185022.149900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185022.150243:0:7503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239316864 00000100:00100000:1.0:1784185022.150254:0:7503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239316864 00000100:00100000:1.0:1784185022.150320:0:7503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 240 00000100:00100000:1.0:1784185022.150377:0:7503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+22:2352:x1870853239316864:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:1.0:1784185022.150413:0:7503:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8aff74 00000020:00010000:1.0:1784185022.150429:0:7503:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b5f880f6000: total 0 00000100:00080000:1.0:1784185022.150434:0:7503:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7419000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784185022.150473:0:7503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1784185022.150878:0:7503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89741aef-63f5-4e1f-9ce7-defb19b62903+21:2352:x1870853239316864:12345-192.168.201.29@tcp:39:umount.0 Request processed in 548us (986us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1784185022.150887:0:7503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 240 00000020:00010000:3.0:1784185022.151362:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b5f880f6000: total 0 00010000:00010000:3.0:1784185022.151407:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b5f880f6000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1784185022.151439:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784185022.151444:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784185022.151453:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896ee00/0x63160f6fbe8b08c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187008 expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151471:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185022.151473:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185022.151477:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158c400/0x63160f6fbe8b0f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871c8 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151510:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:3.0:1784185022.151512:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784185022.151515:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631d600/0x63160f6fbe8b093e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818702b expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151525:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185022.151527:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784185022.151530:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158da00/0x63160f6fbe8b0f65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871d6 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151542:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784185022.151544:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185022.151547:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d600/0x63160f6fbe8b089d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186ffa expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151560:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784185022.151562:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784185022.151565:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f600/0x63160f6fbe8b0c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187104 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151576:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784185022.151579:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784185022.151592:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9c00/0x63160f6fbe8b059b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186f36 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151606:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b5f8296ec00) 00010000:00010000:3.0:1784185022.151608:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784185022.151619:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b023e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e48 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151641:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b5f988b7d00) 00010000:00010000:3.0:1784185022.151643:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784185022.151647:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158dc00/0x63160f6fbe8b095a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187032 expref: 12 pid: 7503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151661:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b5f8c4f5700) 00010000:00010000:3.0:1784185022.151663:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185022.151666:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158ca00/0x63160f6fbe8b07bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186fc2 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151679:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b5f8296e300) 00010000:00010000:3.0:1784185022.151681:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784185022.151684:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b02ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e64 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151698:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b5f8c4f5100) 00010000:00010000:3.0:1784185022.151700:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185022.151703:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc158d800/0x63160f6fbe8b0e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187190 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151718:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f8296e200) 00010000:00010000:3.0:1784185022.151721:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185022.151724:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169800/0x63160f6fbe8b025a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e4f expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185022.151824:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b5f880f6000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1784185022.151846:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185022.151848:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185022.151850:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185022.667835:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784185022.667860:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f83364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784185022.667934:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185022.668152:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510144 00000100:00100000:2.0:1784185022.668180:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510144 00000100:00100000:2.0:1784185022.668228:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784185022.668235:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265510144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784185022.668264:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784185022.668304:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265510144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185022.668309:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784185022.668556:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f83364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265510144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784185022.986893:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185024.017803:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185024.522821:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185024.522869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185024.522922:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185024.523085:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239316992 00000100:00100000:0.0:1784185024.523098:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239316992 00000100:00100000:0.0:1784185024.523196:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239317248 00000100:00100000:0.0:1784185024.523200:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239317248 00000100:00100000:0.0:1784185024.523214:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239317120 00000100:00100000:0.0:1784185024.523217:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239317120 00000100:00100000:0.0:1784185024.523235:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1784185024.523247:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+12:2355:x1870853239316992:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185024.523301:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185024.523329:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f80031800/0x63160f6fbe8b0046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d84 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185024.523386:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185024.523448:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+11:2355:x1870853239316992:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 202us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185024.523456:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1784185024.523479:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1784185024.523485:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+10:2355:x1870853239317248:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185024.523494:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185024.523503:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b01e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186e33 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185024.523512:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185024.523530:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+9:2355:x1870853239317248:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 45us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185024.523537:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1784185024.523561:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1784185024.523567:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+8:2355:x1870853239317120:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185024.523575:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185024.523585:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164b600/0x63160f6fbe8b004d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186dae expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185024.523595:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185024.523612:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fe70326-3f31-45ab-b972-c3f25a334a81+7:2355:x1870853239317120:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 45us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185024.523626:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1784185024.532772:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185024.532979:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239317504 00000100:00100000:3.0:1784185024.532991:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239317504 00000100:00100000:3.0:1784185024.533081:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 241 00000100:00100000:3.0:1784185024.533092:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+6:2352:x1870853239317504:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:3.0:1784185024.533148:0:5792:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8b005b 00000020:00010000:3.0:1784185024.533158:0:5792:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b5f872aa800: total 0 00000100:00080000:3.0:1784185024.533169:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9b5f872ac000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784185024.533204:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1784185024.533512:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a05f5c13-5ab9-4aef-b8cc-20aa74029adb+5:2352:x1870853239317504:12345-192.168.201.29@tcp:39:umount.0 Request processed in 420us (755us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784185024.533521:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 241 00000020:00010000:2.0:1784185024.533940:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b5f872aa800: total 0 00010000:00010000:2.0:1784185024.533947:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185024.534000:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b5f872aa800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784185024.534042:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3600) 00010000:00010000:2.0:1784185024.534047:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784185024.534058:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f9896f800/0x63160f6fbe8b0f88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871e4 expref: 4 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185024.534087:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b5f872aa800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1784185024.534097:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185024.534099:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185024.534101:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784185024.534155:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784185024.556726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185024.556828:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239317760 00000100:00100000:3.0:1784185024.556842:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239317760 00000100:00100000:3.0:1784185024.556912:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 312 00000100:00100000:3.0:1784185024.556924:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+7:2352:x1870853239317760:12345-192.168.201.29@tcp:251:umount.0 00000020:00000080:3.0:1784185024.556984:0:5786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8aff51 00000020:00010000:3.0:1784185024.556993:0:5786:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b5fb7418800: total 0 00000100:00080000:3.0:1784185024.557017:0:5786:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7419800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784185024.557115:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fe70326-3f31-45ab-b972-c3f25a334a81+3:2352:x1870853239317760:12345-192.168.201.29@tcp:251:umount.0 Request processed in 192us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185024.557123:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 312 00000020:00010000:0.0:1784185024.557272:0:7491:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b5fb7418800: total 0 00010000:00010000:0.0:1784185024.557326:0:7491:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b5fb7418800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784185024.557415:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970800/0x63160f6fbe8b0007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838186d76 expref: 2 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185024.557431:0:7491:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b5fb7418800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1784185024.557440:0:7491:0:(genops.c:906:class_export_put()) final put ffff9b5fb7418800/5fe70326-3f31-45ab-b972-c3f25a334a81 00010000:00010000:0.0:1784185024.557454:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185024.557456:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185024.557458:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784185024.558064:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb7418800/5fe70326-3f31-45ab-b972-c3f25a334a81 for MGS 00000020:00000080:3.0:1784185024.558113:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fb7419800 for MGS 00010000:00010000:0.0:1784185025.049318:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784185025.295806:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1784185025.295826:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000001:00080000:1.0:1784185025.295836:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1784185025.295847:0:5814:0:(genops.c:906:class_export_put()) final put ffff9b5f880f6000/89741aef-63f5-4e1f-9ce7-defb19b62903 00000001:00100000:1.0:1784185025.295871:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00000001:00080000:1.0:1784185025.295888:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1784185025.295891:0:5814:0:(genops.c:906:class_export_put()) final put ffff9b5f872aa800/a05f5c13-5ab9-4aef-b8cc-20aa74029adb 00000020:00000080:3.0:1784185025.295907:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f880f6000/89741aef-63f5-4e1f-9ce7-defb19b62903 for lustre-MDT0000 00000020:00000080:3.0:1784185025.296002:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f872aa800/a05f5c13-5ab9-4aef-b8cc-20aa74029adb for lustre-MDT0000 00000020:00000080:3.0:1784185025.296041:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fb7419000 for lustre-MDT0000 00000020:00000080:3.0:1784185025.296047:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f872ac000 for lustre-MDT0000 00000001:00100000:2.0:1784185025.833195:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:2.0:1784185025.833203:0:7506:0:(genops.c:906:class_export_put()) final put ffff9b5fb506c000/89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:3.0:1784185025.833509:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb506c000/89741aef-63f5-4e1f-9ce7-defb19b62903 for lustre-OST0001 00000020:00000080:3.0:1784185025.833578:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fa067c800 for lustre-OST0001 00010000:00010000:2.0:1784185026.059407:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185026.253055:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265510656:0@lo:400:kworker.0 00000100:00100000:3.0:1784185026.253124:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.253181:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784185026.253187:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265510272:0@lo:400:kworker.0 00000100:00100000:3.0:1784185026.253214:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.253235:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265510784:0@lo:400:kworker.0 00000100:00100000:3.0:1784185026.253259:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.253283:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265510528:0@lo:400:kworker.0 00000100:00100000:3.0:1784185026.253305:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.253320:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784185026.253325:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265510400:0@lo:400:kworker.0 00000100:00100000:2.0:1784185026.253543:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510272 00000100:00100000:2.0:1784185026.253552:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510272 00000100:00100000:2.0:1784185026.253601:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1784185026.253610:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265510272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185026.253664:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8727dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265510272:12345-0@lo:400:kworker.0 Request processed in 55us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185026.253678:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1784185026.253714:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510784 00000100:00100000:2.0:1784185026.253718:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510784 00000100:00100000:2.0:1784185026.253753:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510528 00000100:00100000:2.0:1784185026.253756:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510528 00000100:00100000:2.0:1784185026.253778:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784185026.253784:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185026.253818:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265510784:12345-0@lo:400:kworker.0 Request processed in 34us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185026.253823:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784185026.253835:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1784185026.253840:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265510528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185026.253866:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265510528:12345-0@lo:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185026.253872:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:2.0:1784185026.253890:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784185026.253925:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265510272:0@lo:400:kworker.0 00000100:00100000:2.0:1784185026.253939:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265510784:0@lo:400:kworker.0 00000100:00100000:3.0:1784185026.255554:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.255590:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265510912:0@lo:400:kworker.0 00000100:00100000:3.0:1784185026.255620:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.255678:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265510528:0@lo:400:kworker.0 00000100:00100000:3.0:1784185026.255703:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265511040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784185026.255800:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510656 00000100:00100000:0.0:1784185026.255809:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510656 00000100:00100000:0.0:1784185026.255862:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510912 00000100:00100000:0.0:1784185026.255865:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510912 00000100:00100000:0.0:1784185026.255886:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784185026.255893:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265510656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185026.255994:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784185026.256004:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265510912:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784185026.256088:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784185026.256093:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784185026.256105:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265510400 00000100:00100000:2.0:1784185026.256108:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265510400 00000100:00100000:2.0:1784185026.256137:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784185026.256144:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265510400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185026.258428:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265510656:12345-0@lo:400:kworker.0 Request processed in 2525us (5293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185026.258446:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784185026.259696:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185026.259785:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511040 00000100:00100000:0.0:1784185026.259796:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511040 00000100:00100000:0.0:1784185026.259854:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784185026.259862:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265511040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784185026.259903:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185026.259962:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1870853265511040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185026.259982:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784185026.260032:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265511040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784185026.260145:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265510912:12345-0@lo:400:kworker.0 Request processed in 4142us (4522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185026.260155:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784185026.261503:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265510912:0@lo:400:kworker.0 00000100:00100000:2.0:1784185026.261655:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265510400:12345-0@lo:400:kworker.0 Request processed in 5509us (6103us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185026.261676:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784185026.261726:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265510656:0@lo:400:kworker.0 00000100:00100000:2.0:1784185026.261752:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265510400:0@lo:400:kworker.0 00000020:01000004:1.0:1784185026.675315:0:12779:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784185026.714113:0:12779:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784185026.714180:0:12779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.714197:0:12779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.714204:0:12779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.714212:0:12779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.714239:0:12779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784185026.714245:0:12779:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784185026.714272:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784185026.714276:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784185026.714282:0:12779:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784185026.714306:0:12779:0:(import.c:65:import_set_state_nolock()) ffff9b5faf265000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1784185026.714528:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185026.714536:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.714544:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b800 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784185026.714548:0:7491:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.714556:0:7491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784185026.714565:0:7491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185026.714571:0:7491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784185026.714573:0:7491:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784185026.714575:0:7491:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784185026.714603:0:7491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.714609:0:7491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784185026.714630:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.714638:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8164b800/0x63160f6fbe8affd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affdd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.714651:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185026.714653:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185026.714668:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185026.714818:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265511296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784185026.714894:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185026.716990:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511296 00000100:00100000:0.0:1784185026.717004:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511296 00000100:00100000:0.0:1784185026.717081:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784185026.717092:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f91f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3315:x1870853265511296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784185026.717108:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185026.717141:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164ba00/0x63160f6fbe8affdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8affd6 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.717158:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185026.717235:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f91f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:3315:x1870853265511296:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185026.717243:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784185026.717536:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265511296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784185026.717629:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265511168:0@lo:39:umount.0 00000100:00100000:2.0:1784185026.717671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185026.722866:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511168 00000100:00100000:1.0:1784185026.722896:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511168 00000100:00100000:0.0:1784185026.726721:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784185026.726738:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f83364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870853265511168:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784185026.726922:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afd60 00000100:00080000:0.0:1784185026.726934:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9b5f87f12000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784185026.727106:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f83364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3312:x1870853265511168:12345-0@lo:39:umount.0 Request processed in 372us (9433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185026.727115:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1784185026.727140:0:5793:0:(genops.c:906:class_export_put()) final put ffff9b5f87f17800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784185026.727166:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f87f17800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784185026.727215:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f87f12000 for lustre-MDT0000 00010000:00010000:2.0:1784185026.727263:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784185026.727687:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5faf265000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784185026.727707:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265511168:0@lo:39:umount.0 00000100:00080000:1.0:1784185026.727849:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784185026.727853:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784185026.727858:0:12779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784185026.729530:0:12779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.729548:0:12779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.729555:0:12779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.729561:0:12779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185026.729667:0:12779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784185026.729742:0:12779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.729751:0:12779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.729788:0:12779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.729795:0:12779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729827:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185026.729836:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729842:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f80030200 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784185026.729846:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729855:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784185026.729862:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185026.729867:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784185026.729869:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784185026.729905:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729912:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784185026.729944:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729962:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f80030200/0x63160f6fbe8affe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affeb expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729978:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185026.729981:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729987:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c400 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784185026.729990:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.729998:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784185026.730004:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185026.730008:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784185026.730010:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1784185026.730023:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.730029:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784185026.730045:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.730052:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185026.730054:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185026.730055:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185026.730079:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265511552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784185026.730166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185026.730573:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784185026.730584:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265511424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784185026.730617:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.730704:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511552 00000100:00100000:3.0:1784185026.730712:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511552 00000100:00100000:3.0:1784185026.730772:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511424 00000100:00100000:3.0:1784185026.730776:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511424 00000100:00100000:3.0:1784185026.730801:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784185026.730810:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+19:3313:x1870853265511552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784185026.730822:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185026.730836:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970c00/0x63160f6fbe8aff12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8aff0b expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.730852:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185026.730888:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+18:3313:x1870853265511552:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185026.730895:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784185026.730911:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784185026.730916:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+17:3315:x1870853265511424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784185026.730935:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185026.730944:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164a200/0x63160f6fbe8affeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8affe4 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.730954:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185026.730981:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3315:x1870853265511424:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185026.730988:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784185026.731030:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3313:1870853265511552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784185026.731054:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265511424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784185026.731745:0:12779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784185026.731758:0:12779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c400/0x63160f6fbe8aff0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8aff12 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185026.731783:0:12779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784185026.731793:0:12779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.731800:0:12779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.731806:0:12779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.731811:0:12779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.731901:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185026.731908:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.731917:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631de00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784185026.731920:0:7491:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.731928:0:7491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784185026.731935:0:7491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185026.731940:0:7491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784185026.731942:0:7491:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1784185026.731969:0:7491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.731976:0:7491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784185026.732006:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.732016:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185026.732017:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185026.732020:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185026.732060:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265511680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784185026.732105:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185026.732934:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511680 00000100:00100000:2.0:1784185026.732944:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511680 00000100:00100000:2.0:1784185026.733002:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784185026.733023:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+16:3314:x1870853265511680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784185026.733038:0:7492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185026.733055:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631c000/0x63160f6fbe8b0214 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8b020d expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185026.733067:0:7492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185026.733187:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:3314:x1870853265511680:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185026.733195:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1784185026.733581:0:12779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784185026.733589:0:12779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631de00/0x63160f6fbe8b020d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8b0214 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185026.733600:0:12779:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784185026.733610:0:12779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.733627:0:12779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.733634:0:12779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.733640:0:12779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185026.733662:0:12779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784185026.733666:0:12779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1784185026.733668:0:12779:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1784185026.733709:0:12779:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1784185026.733713:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1784185026.733717:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784185026.733723:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784185026.733729:0:12779:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b5fb9338000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784185026.733734:0:12779:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b5faec51000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784185026.733740:0:12779:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9b5fb74c4d40) has exports, disconnecting them 00000020:00080000:0.0:1784185026.733744:0:12779:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b5fb9338000), last request at 1784185026 00000020:00000080:0.0:1784185026.733751:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afed3 00010000:00010000:3.0:1784185026.733868:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784185026.733875:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.733882:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f80030600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784185026.733886:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.733894:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784185026.733901:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784185026.733907:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784185026.733916:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784185026.733918:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784185026.733945:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.733951:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784185026.733971:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.733979:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f80030600/0x63160f6fbe8afcbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8afcc6 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.733994:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185026.733995:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185026.733997:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185026.734004:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784185026.734016:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265511808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784185026.734058:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.734104:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511808 00000100:00100000:3.0:1784185026.734109:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511808 00000100:00100000:3.0:1784185026.734223:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784185026.734233:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+15:3316:x1870853265511808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784185026.734243:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185026.734253:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8afcc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8afcbf expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185026.734267:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185026.734502:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7+14:3316:x1870853265511808:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185026.734521:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784185026.734569:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3316:1870853265511808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784185026.734631:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784185026.734675:0:12779:0:(import.c:65:import_set_state_nolock()) ffff9b5fb933d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784185026.734738:0:12779:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b5fb9338000): rc 0 00000020:00000080:0.0:1784185026.734741:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fb9338000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1784185026.734759:0:12779:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b5faec51000), last request at 1784185026 00000020:00000080:0.0:1784185026.734763:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afdfa 00010000:00010000:2.0:1784185026.734850:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784185026.734877:0:12779:0:(import.c:65:import_set_state_nolock()) ffff9b5faec54800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784185026.734896:0:12779:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b5faec51000): rc 0 00000020:00000080:0.0:1784185026.734904:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5faec51000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1784185026.734912:0:12779:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac49c3e2fae0 00000100:00080000:0.0:1784185026.734931:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784185026.734935:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1784185026.734947:0:12779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784185026.735004:0:12779:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1784185026.735020:0:12779:0:(import.c:65:import_set_state_nolock()) ffff9b5f844a8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784185026.735032:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784185026.735035:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1784185026.735045:0:12779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1784185026.735103:0:12779:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1784185026.735111:0:12779:0:(import.c:65:import_set_state_nolock()) ffff9b5e813e3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784185026.735214:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784185026.735255:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b5fb74c4d40) has no exports 00000020:00000080:3.0:1784185026.738538:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb9338000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784185026.738608:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5faec51000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784185026.738631:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fb933d800 for lustre-MDT0000 00000020:00000080:3.0:1784185026.738636:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5faec54800 for lustre-MDT0000 00000100:00100000:3.0:1784185026.738665:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265511936:0@lo:9:umount.0 00000100:00100000:3.0:1784185026.738742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.738796:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265512064:0@lo:9:umount.0 00000100:00100000:3.0:1784185026.738821:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185026.738863:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265511936 00000100:00100000:3.0:1784185026.738872:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265511936 00000100:00100000:3.0:1784185026.738914:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265512064 00000100:00100000:3.0:1784185026.738918:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265512064 00000100:00100000:3.0:1784185026.738940:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784185026.738950:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870853265511936:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784185026.738978:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afe4e 00000100:00080000:3.0:1784185026.738988:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d92800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784185026.739026:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1784185026.739862:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3312:x1870853265511936:12345-0@lo:9:umount.0 Request processed in 910us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185026.739872:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784185026.739895:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784185026.739903:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1870853265512064:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784185026.739918:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8aff4a 00000100:00080000:3.0:1784185026.739924:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9b5fb741d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784185026.739945:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1784185026.740274:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3312:x1870853265512064:12345-0@lo:9:umount.0 Request processed in 372us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185026.740295:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1784185026.740328:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784185026.740888:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5f844a8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784185026.740912:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784185026.740914:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784185026.740919:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265511936:0@lo:9:umount.0 00000100:00080000:3.0:1784185026.740934:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5e813e3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784185026.740939:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784185026.740941:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784185026.740943:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265512064:0@lo:9:umount.0 00010000:00010000:3.0:1784185026.740971:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185026.741097:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3314:1870853265511680:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784185026.779663:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b5fb74c4d40) has no exports 00000020:00000080:0.0:1784185026.852086:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afd1a 00000020:00000080:0.0:1784185026.852103:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fc0d22000/lustre-QMT0000_UUID 00000020:01000000:0.0:1784185026.852135:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784185026.852376:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fc0d22000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784185026.852632:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784185026.852644:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784185026.852649:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9b5f982cb380) has no exports 00000020:00000080:1.0:1784185026.853789:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afd13 00000020:00000080:1.0:1784185026.853800:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fb7d94800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784185026.853863:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185026.853872:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784185026.853874:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5f982d2000/lustre-QMT0000_UUID 00000020:00000080:1.0:1784185026.853877:0:12779:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f982d2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1784185026.853886:0:12779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1784185026.854139:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb7d94800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784185026.854241:0:12779:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5f90590780 - data ffff9b5fb1c6d000/ffff9b5fc139c800 00000020:01000000:1.0:1784185026.854398:0:12779:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5f91faec60 - data ffff9b5fb1c1dbd0/ffff9b5fc0f66400 00000001:00100000:3.0:1784185026.856380:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89741aef-63f5-4e1f-9ce7-defb19b62903 00000020:00000080:3.0:1784185026.856388:0:6613:0:(genops.c:906:class_export_put()) final put ffff9b5f83389800/89741aef-63f5-4e1f-9ce7-defb19b62903 00000001:00100000:3.0:1784185026.856410:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784185026.856413:0:6613:0:(genops.c:906:class_export_put()) final put ffff9b5f844ad800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784185026.856575:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f83389800/89741aef-63f5-4e1f-9ce7-defb19b62903 for lustre-OST0000 00000020:00000080:0.0:1784185026.856618:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f844ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784185026.856635:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f8338d800 for lustre-OST0000 00000020:00000080:0.0:1784185026.856640:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fb7d92800 for lustre-OST0000 00000001:00000004:0.0:1784185026.877518:0:12779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1784185026.951863:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784185026.951873:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1784185026.951901:0:12779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784185026.951904:0:12779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784185026.952385:0:6712:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784185026.952390:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1784185026.952405:0:6712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784185026.953250:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784185026.953257:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1784185026.953285:0:12779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784185026.953287:0:12779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784185026.954441:0:7811:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784185026.954449:0:7811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1784185026.954462:0:7811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1784185027.003182:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afce2 00000020:00000080:1.0:1784185027.003196:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fb74ac800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784185027.004485:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afcf7 00000020:00000080:1.0:1784185027.004497:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fb74ce000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784185027.004520:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784185027.004526:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784185027.004534:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784185027.004538:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9b5f982c99c0) has no exports 00000004:01000000:1.0:1784185027.004708:0:12779:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784185027.004717:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8aff35 00000020:00000080:1.0:1784185027.004722:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fc0f70000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784185027.004726:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784185027.004729:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784185027.004736:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784185027.004738:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9b5fb74c3380) has no exports 00000020:00000080:1.0:1784185027.004744:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8aff2e 00000020:00000080:1.0:1784185027.004748:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fc0f76000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784185027.005126:0:12779:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784185027.005131:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784185027.005135:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1784185027.005141:0:12779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784185027.005145:0:12779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784185027.005175:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185027.005181:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784185027.005188:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afe40 00000020:00000080:1.0:1784185027.005193:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fbf93d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784185027.005197:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784185027.005200:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784185027.005203:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784185027.005214:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9b5f844f99c0) has no exports 00000020:00000080:1.0:1784185027.005218:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afe39 00000020:00000080:1.0:1784185027.005221:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5f844ab000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1784185027.005605:0:12779:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784185027.005609:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784185027.005611:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1784185027.005615:0:12779:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784185027.005616:0:12779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784185027.005636:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185027.005641:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784185027.005664:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185027.005666:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784185027.005692:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afcfe 00000020:00000080:1.0:1784185027.005697:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fb74cb000/lustre-MDD0000_UUID 00000020:01000000:1.0:1784185027.005700:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784185027.005703:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784185027.005706:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784185027.005708:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9b5fb74c0000) has no exports 00000020:00000080:1.0:1784185027.005729:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185027.005731:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784185027.005734:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afd05 00000020:00000080:1.0:1784185027.005737:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fb74c8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784185027.005744:0:12779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5f85958000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784185027.005747:0:12779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5f85958000 3 00000020:01000004:1.0:1784185027.005750:0:12779:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b5f85958000 from lustre-MDT0000 00000020:00000080:1.0:1784185027.005766:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185027.005770:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784185027.005772:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fb74aa000/lustre-MDT0000_UUID 00000020:00000080:1.0:1784185027.005774:0:12779:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb74aa000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784185027.005781:0:12779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784185027.005857:0:12779:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1784185027.005861:0:12779:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784185027.005871:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784185027.005873:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784185027.005876:0:12779:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784185027.005883:0:12779:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9b5f83f57000 dd3a63d1-a8e3-43ef-9771-5d6fc11873d7 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784185027.005888:0:12779:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9b5f844fcd40) has exports, disconnecting them 00000020:00080000:1.0:1784185027.005892:0:12779:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b5f83f57000), last request at 1784184782 00000020:00000080:1.0:1784185027.005905:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afca3 00000020:00010000:1.0:1784185027.005909:0:12779:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b5f83f57000: total 8 00000100:00080000:1.0:1784185027.005913:0:12779:0:(import.c:65:import_set_state_nolock()) ffff9b5f83f56800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784185027.005936:0:12779:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b5f83f57000): rc 0 00000020:00080000:1.0:1784185027.005940:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9b5f844fcd40) has no exports 00000100:00100000:1.0:1784185027.005991:0:5784:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b5f82ec1e00:5784] 0 exiting: rc = 1 00000020:00000080:2.0:1784185027.006253:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb74ac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784185027.006269:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb74ce000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1784185027.006273:0:8:0:(genops.c:906:class_export_put()) final put ffff9b5f982d3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784185027.006275:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f982d3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784185027.006278:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784185027.006405:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fc0f70000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784185027.006410:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fc0f76000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784185027.006414:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5e813e3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1784185027.006424:0:8:0:(genops.c:906:class_export_put()) final put ffff9b5f880f1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784185027.006427:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f880f1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1784185027.006431:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784185027.006457:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fbf93d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784185027.006461:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f844ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784185027.006464:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f844a8000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1784185027.006467:0:8:0:(genops.c:906:class_export_put()) final put ffff9b5faec51800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784185027.006469:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5faec51800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1784185027.006472:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784185027.006537:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb74cb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1784185027.006541:0:8:0:(genops.c:906:class_export_put()) final put ffff9b5fb74cd000/lustre-MDD0000_UUID 00000020:00000080:2.0:1784185027.006543:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb74cd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1784185027.006548:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1784185027.006680:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb74c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1784185027.006704:0:5787:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b5f82ec0a00:5787] 2 exiting: rc = 0 00000100:00100000:2.0:1784185027.006759:0:5786:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b5f86455400:5786] 1 exiting: rc = 0 00000100:00100000:2.0:1784185027.006814:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006822:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006828:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006834:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006839:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006845:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006850:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006856:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006862:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006869:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006877:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006882:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006888:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006894:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006907:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006914:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006919:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006924:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006930:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006936:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006942:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006947:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006952:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006957:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006963:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006968:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006973:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006979:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006984:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006989:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.006996:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007002:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007007:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007013:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007019:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007025:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007031:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007037:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007042:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007048:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007054:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007059:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007065:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007072:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007078:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007084:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007090:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007096:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007101:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007113:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007131:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007138:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007143:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007148:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007153:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007159:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007165:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007170:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007175:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007180:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007185:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007190:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007195:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.007200:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1784185027.007556:0:12779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784185027.007560:0:12779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1784185027.008005:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b5f83f57000: total 0 00010000:00010000:0.0:1784185027.008053:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b5f83f57000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1784185027.008084:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8164a800/0x63160f6fbe8affcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8affc8 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008113:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b0206 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8b01ff expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008135:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970000/0x63160f6fbe8afff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8afff2 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008144:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971800/0x63160f6fbe8b01f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8b01f1 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008156:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f80030000/0x63160f6fbe8afdad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8afda6 expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008168:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971000/0x63160f6fbe8affa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8aff9e expref: 4 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008177:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970600/0x63160f6fbe8affc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8affba expref: 3 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008186:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93970400/0x63160f6fbe8affb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x63160f6fbe8affac expref: 2 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185027.008197:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b5f83f57000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1784185027.008210:0:5781:0:(genops.c:906:class_export_put()) final put ffff9b5f83f57000/dd3a63d1-a8e3-43ef-9771-5d6fc11873d7 00010000:00010000:0.0:1784185027.008229:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185027.008231:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185027.008232:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784185027.008312:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f83f57000/dd3a63d1-a8e3-43ef-9771-5d6fc11873d7 for MGS 00000020:00000080:2.0:1784185027.008366:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f83f56800 for MGS 00000020:01000000:2.0:1784185027.009069:0:12779:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5f905901e0 - data ffff9b5fb1c24d80/ffff9b5fc139e400 00000020:01000000:2.0:1784185027.009243:0:12779:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5f90d69b40 - data ffff9b5fb1c601b0/ffff9b5f982eb400 00000020:00000080:2.0:1784185027.009706:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afc87 00000020:00000080:2.0:1784185027.009713:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5f941a2800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784185027.009729:0:12779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5f85958000 from MGS, refs=2 00000020:01000004:2.0:1784185027.009732:0:12779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5f85958000 2 00000020:01000004:2.0:1784185027.009736:0:12779:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b5f85958000 from MGS 00000020:00000080:2.0:1784185027.009760:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784185027.009766:0:12779:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784185027.009768:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5f873bb000/MGS 00000020:00000080:2.0:1784185027.009771:0:12779:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f873bb000/MGS for MGS 00000020:01000000:2.0:1784185027.009776:0:12779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784185027.009825:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784185027.009829:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784185027.009834:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784185027.009849:0:12779:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b5faf267000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784185027.009855:0:12779:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9b5f982ccd40) has exports, disconnecting them 00000020:00080000:2.0:1784185027.009859:0:12779:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b5faf267000), last request at 1784184783 00000020:00000080:2.0:1784185027.009863:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afd52 00000020:00080000:2.0:1784185027.009870:0:12779:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b5faf267000): rc 0 00000020:00000080:2.0:1784185027.009875:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5faf267000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784185027.010229:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f941a2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784185027.010242:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5faf267000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784185027.010624:0:12779:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784185027.010629:0:12779:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784185027.010633:0:12779:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784185027.010638:0:12779:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784185027.010779:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784185027.010785:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784185027.010789:0:12779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5f85958000 1 00000020:00000080:2.0:1784185027.010793:0:12779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afc79 00000020:00000080:2.0:1784185027.010798:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5f873bf800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784185027.011202:0:1384:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5faf265000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784185027.011218:0:1384:0:(genops.c:906:class_export_put()) final put ffff9b5fb7d96000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784185027.011221:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb7d96000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784185027.011227:0:1384:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1784185027.011317:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784185027.011323:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784185027.011326:0:12779:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784185027.011353:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9b5f90584d40) has no exports 00000020:00000080:0.0:1784185027.011531:0:1384:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f873bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1784185027.091311:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784185027.097582:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185027.097597:0:12779:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784185027.097602:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5fa067f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784185027.097607:0:12779:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fa067f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784185027.097614:0:12779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784185027.097748:0:12779:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b5f8ba71800 00000020:01000000:1.0:1784185027.097777:0:12779:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1784185027.097781:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784185027.097786:0:12779:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784185027.097790:0:12779:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9b5f982c8000) has no exports 00000100:00100000:1.0:1784185027.097881:0:7503:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b5f82e23600:7503] 3 exiting: rc = 0 00000100:00100000:2.0:1784185027.101047:0:5794:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b5f89311c00:5794] 2 exiting: rc = 0 00000100:00100000:2.0:1784185027.101209:0:5792:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b5fa4d75800:5792] 0 exiting: rc = 1 00000100:00100000:0.0:1784185027.101643:0:5793:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b5f89311600:5793] 1 exiting: rc = 0 00000100:00100000:1.0:1784185027.102599:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102609:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102615:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102621:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102627:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102633:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102640:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102646:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102668:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102674:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102680:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102687:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102693:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102699:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102705:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102711:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102716:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102722:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102727:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102733:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102741:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102747:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102752:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102758:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102764:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102770:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102776:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102782:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102788:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102793:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102800:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102805:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102812:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102817:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102824:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102830:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102836:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102842:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102848:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102854:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102860:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102865:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102871:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102884:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102890:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102896:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102902:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102907:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102914:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102921:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102926:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102932:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102938:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102945:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102951:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102957:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102963:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102968:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102974:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102980:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102985:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102991:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.102996:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.103001:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.109091:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b5fa4d75e00:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1784185027.109323:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b5f89311400:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1784185027.109736:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109746:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109752:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109758:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109764:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109770:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109777:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109783:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109789:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109796:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109802:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109808:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109815:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109820:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109825:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109829:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109834:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109838:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109844:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109849:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109854:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109860:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109866:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109871:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109876:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109880:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109886:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109890:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109912:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109917:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109922:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109927:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109932:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109938:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109942:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109946:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109951:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109956:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109960:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109965:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109970:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109976:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109981:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109986:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109991:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.109995:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110000:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110004:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110009:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110014:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110020:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110025:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110030:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110035:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110041:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110048:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110053:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110057:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110062:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110068:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110073:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110078:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110083:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110096:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.110679:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b5f8c5fe800:5798] 1 exiting: rc = 0 00000100:00100000:1.0:1784185027.110845:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b5fa4d75400:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1784185027.110937:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110945:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110951:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110958:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110964:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110972:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110979:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110985:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110991:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.110996:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111013:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111022:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111027:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111034:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111040:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111046:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111053:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111059:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111064:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111070:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111076:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111082:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111105:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111113:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111197:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111206:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111212:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111217:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111225:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111231:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111237:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111245:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111250:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111256:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111285:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111292:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111297:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111304:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111310:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111316:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111322:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111327:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111416:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111422:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111427:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111433:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111453:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111460:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111465:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111470:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111476:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111481:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111487:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111493:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111498:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111516:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111523:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111529:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111548:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111555:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111560:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111565:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111570:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185027.111580:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.143546:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b5f8c5ffa00:5799] 0 exiting: rc = 1 00000100:00100000:0.0:1784185027.145183:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b5f86d6f800:5800] 1 exiting: rc = 0 00000100:00100000:1.0:1784185027.145256:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145264:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145269:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145274:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145279:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145283:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145288:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145293:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145297:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145302:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145306:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145311:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145328:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145362:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145367:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145372:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145376:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145381:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145386:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145391:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145396:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145401:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145406:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145411:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145415:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145420:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145426:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145431:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145436:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145441:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145447:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145452:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145457:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145462:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145467:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145472:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145477:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145483:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145489:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145498:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145517:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145522:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145527:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145532:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145538:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145543:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145548:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145562:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145566:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145572:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145577:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145581:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145585:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145589:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145594:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145598:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145603:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145607:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145612:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145617:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145622:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145626:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145631:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145635:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.145997:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b5f89effa00:5802] 1 exiting: rc = 0 00000100:00100000:2.0:1784185027.146175:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b5f89eff000:5801] 0 exiting: rc = 1 00000100:00100000:1.0:1784185027.148355:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148366:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148371:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148375:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148381:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148385:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148390:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148395:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148400:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148404:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148409:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148413:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148418:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148423:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148428:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148433:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148438:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148463:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148470:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148474:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148478:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148483:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148487:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148493:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148498:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148513:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148518:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148523:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148528:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148533:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148537:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148542:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148546:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148551:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148556:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148561:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148567:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148573:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148578:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148583:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148587:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148592:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148597:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148602:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148606:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148610:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148615:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148621:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148646:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148651:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148656:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148661:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148673:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148678:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148683:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148688:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148693:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148698:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148702:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148706:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148711:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148716:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148721:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.148726:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149112:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b5f89effc00:5804] 1 exiting: rc = 0 00000100:00100000:2.0:1784185027.149251:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b5f89efea00:5803] 0 exiting: rc = 1 00000100:00100000:1.0:1784185027.149409:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149415:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149420:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149424:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149429:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149434:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149438:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149443:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149447:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149452:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149457:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149461:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149467:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149473:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149478:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149487:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149492:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149496:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149510:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149516:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149520:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149526:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149540:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149545:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149549:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149554:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149559:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149564:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149569:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149573:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149578:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149582:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149588:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149592:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149597:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149602:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149607:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149612:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149617:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149622:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149627:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149632:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149637:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149641:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149646:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149650:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149655:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149660:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149665:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149670:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149675:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149681:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149685:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149690:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149694:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149698:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149703:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149719:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149724:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149728:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149732:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149737:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149742:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.149747:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784185027.150355:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b5f9828d400:5805] 0 exiting: rc = 1 00000100:00100000:1.0:1784185027.150801:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b5f832c5800:5806] 1 exiting: rc = 0 00000100:00100000:1.0:1784185027.150951:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b5f83857200:5807] 2 exiting: rc = 0 00000100:00100000:1.0:1784185027.151001:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151007:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151012:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151017:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151023:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151028:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151034:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151048:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151055:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151060:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151066:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151070:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151075:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151080:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151086:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151092:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151097:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151102:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151108:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151112:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151230:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151238:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151245:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151250:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151255:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151260:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151276:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151281:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151287:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151291:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151296:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151315:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151321:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151326:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151366:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151372:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151376:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151382:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151387:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151393:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151398:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151404:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151410:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151415:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151421:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151426:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151432:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151438:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151443:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151448:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151453:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151459:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151464:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151469:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151474:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151495:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151512:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151518:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151523:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151529:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151534:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151546:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151553:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784185027.151559:0:12779:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784185027.159969:0:12779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784185027.159983:0:12779:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1784185027.159989:0:12779:0:(genops.c:906:class_export_put()) final put ffff9b5f844ae800/MDS_uuid 00000020:00000080:1.0:1784185027.159993:0:12779:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f844ae800/MDS_uuid for MDS 00000020:01000000:1.0:1784185027.159999:0:12779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1784185027.160121:0:12779:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784185028.107524:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185029.132872:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185030.154617:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784185030.339713:0:12928:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784185030.364564:0:12928:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784185030.364633:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185030.364671:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185030.364678:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185030.364685:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185030.364723:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784185030.364729:0:12928:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784185030.364762:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784185030.364768:0:12928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784185030.364777:0:12928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784185030.364811:0:12928:0:(import.c:65:import_set_state_nolock()) ffff9b5fbf645800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784185030.365032:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784185030.365042:0:7491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185030.365050:0:7491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970200 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784185030.365054:0:7491:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185030.365182:0:7491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784185030.365203:0:7491:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784185030.365209:0:7491:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784185030.365212:0:7491:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784185030.365215:0:7491:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784185030.365251:0:7491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185030.365258:0:7491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784185030.365295:0:7491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185030.365303:0:7491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f93970200/0x63160f6fbe8affba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x63160f6fbe8affc1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185030.365316:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185030.365318:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185030.365349:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185030.365364:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784185030.365388:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265512320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784185030.365508:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185030.365742:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1870853265512192:0@lo:39:umount.0 00000400:00000100:2.0:1784185030.365772:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870853265512192 offset 0 length 224: 4 00000100:00100000:2.0:1784185030.365820:0:7492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265512320 00000100:00100000:2.0:1784185030.365828:0:7492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265512320 00000100:00100000:2.0:1784185030.365881:0:7492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784185030.365899:0:7492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1870853265512320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784185030.365906:0:7492:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784185030 with bad export cookie 7139911231855066275 00000100:00100000:3.0:1784185030.393365:0:7492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1870853265512320:12345-0@lo:103:ldlm_bl.0 Request processed in 27442us (27824us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784185030.393382:0:7492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1784185030.393539:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784185030.393549:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9b5f83f51800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784185030.393555:0:3315:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1784185030.417851:0:3315:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.129@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784185030.417857:0:3315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784185030.417867:0:3315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b5fbf50df80 x1870853265512320/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784185046 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784185030.417881:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784185030.417884:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784185030.417885:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784185030.417889:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9b5f83f51800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784185030.417893:0:3315:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 180 00000100:00080000:0.0:1784185030.417916:0:3315:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9b5f83f51800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1784185030.418051:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fc1637800 x1870853265512448/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784185030.418110:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3315:1870853265512320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784185030.418183:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3312:1870853265512448:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1784185030.418236:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870853265512448 offset 0 length 520: 4 00000001:00100000:0.0:1784185030.934697:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784185030.934707:0:7506:0:(genops.c:906:class_export_put()) final put ffff9b5fb741c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784185030.934806:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb741c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784185030.934860:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fb741d000 for lustre-OST0001 00010000:00010000:1.0:1784185031.178976:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784185031.370523:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784185031.370534:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784185031.370627:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265512576:0@lo:400:kworker.0 00000400:00000100:3.0:1784185031.370685:0:3313:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870853265512576 offset 0 length 224: 4 00010000:00010000:1.0:1784185032.202871:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185033.226568:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185034.250584:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185035.280889:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784185035.403120:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784185035.403140:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784185035.403361:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784185035.403390:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265512704:0@lo:400:kworker.0 00000400:00000100:3.0:1784185035.403448:0:3313:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870853265512704 offset 0 length 224: 4 00010000:00010000:3.0:1784185036.298580:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185037.322612:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185038.346884:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185039.370625:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185040.399384:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784185040.586619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784185040.586629:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784185040.586873:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784185040.586907:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265512832:0@lo:400:kworker.0 00000400:00000100:0.0:1784185040.586965:0:3316:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870853265512832 offset 0 length 224: 4 00000100:00100000:3.0:1784185040.587386:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784185030/real 1784185030] req@ffff9b5fc1637800 x1870853265512448/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784185040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784185040.587412:0:3312:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b5fc1637800 x1870853265512448/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784185040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784185040.587423:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784185030/real 1784185030] req@ffff9b5faf057100 x1870853265512192/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784185040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784185040.587436:0:3312:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b5faf057100 x1870853265512192/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784185040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784185040.587449:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5f83f51800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784185040.587466:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784185040.587470:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3312:1870853265512448:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1784185040.587476:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fbf645800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784185040.587494:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1870853265512192:0@lo:39:umount.0 00000100:00080000:2.0:1784185040.587810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784185040.587815:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784185040.587818:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b5f83f51800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784185040.587823:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 428 00000100:00080000:2.0:1784185040.587828:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784185040.587834:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9b5f83f51800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784185040.587858:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbfbcea00 x1870853265512960/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784185040.588088:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784185040.588093:0:12928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784185040.588099:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1784185040.589817:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3312:1870853265512960:0@lo:250:kworker.0 00000400:00000100:3.0:1784185040.589870:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870853265512960 offset 0 length 520: 4 00010000:00010000:0.0:1784185040.596550:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.596570:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.597412:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.597421:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.597455:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784185040.597465:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.597472:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.597492:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.597498:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185040.597516:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784185040.597519:0:12928:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784185040.597548:0:12928:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784185040.597552:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784185040.597556:0:12928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784185040.597561:0:12928:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784185040.597565:0:12928:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b5f90583380) has no exports 00000020:00080000:0.0:1784185040.597604:0:12928:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b5f90583380) has no exports 00010000:00010000:1.0:1784185040.599765:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784185040.599779:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599790:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:1.0:1784185040.599794:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599821:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784185040.599828:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185040.599834:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784185040.599837:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1784185040.599841:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1784185040.599860:0:5780:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b5f83f51800 00010000:00010000:1.0:1784185040.599864:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599870:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f93971600/0x63160f6fbe8affc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8affcf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599885:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185040.599889:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599905:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8c00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:1.0:1784185040.599908:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599914:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784185040.599920:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185040.599935:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784185040.599937:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784185040.599939:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1784185040.599945:0:5780:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b5f83f51800 00010000:00010000:1.0:1784185040.599948:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599954:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b01ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8b0206 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185040.599963:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185040.599965:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185040.599966:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185040.600150:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784185040.608930:0:12928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5f90556d80 - data ffff9b5fb1c7c870/ffff9b5fa01b6000 00000020:01000000:0.0:1784185040.609060:0:12928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5f864f3c00 - data ffff9b5e814d85e8/ffff9b5f85ee8400 00100000:10000000:0.0:1784185040.620810:0:12928:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784185040.651310:0:12928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afdc9 00000020:00000080:3.0:1784185040.651320:0:12928:0:(genops.c:906:class_export_put()) final put ffff9b5fb8141000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1784185040.651368:0:12928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5fc0d20000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1784185040.651387:0:12928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fc0d20000 2 00000020:01000004:3.0:1784185040.651391:0:12928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b5fc0d20000 from lustre-OST0000 00000020:00000080:3.0:1784185040.651416:0:12928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784185040.651426:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1784185040.651429:0:12928:0:(genops.c:906:class_export_put()) final put ffff9b5fb7d90000/lustre-OST0000_UUID 00000020:00000080:3.0:1784185040.651432:0:12928:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb7d90000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1784185040.651438:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1784185040.651479:0:12928:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1784185040.651483:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784185040.651486:0:12928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784185040.651491:0:12928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784185040.651497:0:12928:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b5fbf640000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784185040.651503:0:12928:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9b5fb74c19c0) has exports, disconnecting them 00000020:00080000:3.0:1784185040.651507:0:12928:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b5fbf640000), last request at 1784184799 00000020:00000080:3.0:1784185040.651511:0:12928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afdf3 00000020:00080000:3.0:1784185040.651521:0:12928:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b5fbf640000): rc 0 00000020:00000080:3.0:1784185040.651527:0:12928:0:(genops.c:906:class_export_put()) final put ffff9b5fbf640000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784185040.652219:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb8141000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784185040.652233:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fbf640000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784185040.652818:0:12928:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784185040.652823:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784185040.652827:0:12928:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784185040.652834:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784185040.652991:0:12928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784185040.653000:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1784185040.653007:0:12928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fc0d20000 1 00000020:00000080:0.0:1784185040.653012:0:12928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afd83 00000020:00000080:0.0:1784185040.653019:0:12928:0:(genops.c:906:class_export_put()) final put ffff9b5faec52000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784185040.653036:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784185040.653040:0:12928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784185040.653043:0:12928:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784185040.653047:0:12928:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9b5f905819c0) has no exports 00000020:00000080:1.0:1784185040.653160:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fbf645800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784185040.653179:0:8:0:(genops.c:906:class_export_put()) final put ffff9b5fbf640800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1784185040.653181:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fbf640800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1784185040.653191:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1784185040.653244:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5faec52000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784185040.678511:0:12928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784185040.678529:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1784185040.678536:0:12928:0:(genops.c:906:class_export_put()) final put ffff9b5fa0593000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1784185040.678541:0:12928:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fa0593000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1784185040.678552:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1784185040.678716:0:12928:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b5fc0d24000 00000020:02000400:0.0:1784185040.678781:0:12928:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1784185041.418518:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185042.454360:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185043.466479:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784185043.734061:0:13081:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784185043.747597:0:13081:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784185043.747678:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185043.747693:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185043.747701:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185043.747720:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185043.747743:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784185043.747748:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784185043.747773:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784185043.747784:0:13081:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b5fc1636a00 x1870853265512576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185047 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185043.747805:0:13081:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b5faf057b80 x1870853265512704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185051 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185043.747814:0:13081:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b5fbfbcfb80 x1870853265512832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185056 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185043.747826:0:13081:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784185043.747831:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784185043.747998:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9b5fbf642800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1784185043.748111:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185043.748119:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185043.748128:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631da00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784185043.748132:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185043.748142:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784185043.748149:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185043.748154:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784185043.748157:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784185043.748159:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784185043.748172:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b5f83f51800 00010000:00010000:0.0:1784185043.748176:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185043.748190:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631da00/0x63160f6fbe8aff9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8affa5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185043.748201:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185043.748203:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185043.748205:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185043.748244:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265512832:0@lo:400:kworker.0 00000100:00100000:2.0:1784185043.748392:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265512704:0@lo:400:kworker.0 00000100:00100000:2.0:1784185043.748401:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265512576:0@lo:400:kworker.0 00000100:00100000:0.0:1784185043.749406:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1870853265513088:0@lo:39:umount.0 00000400:00000100:0.0:1784185043.749463:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870853265513088 offset 0 length 224: 4 00010000:00010000:1.0:1784185044.490941:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185045.515505:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784185045.707645:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784185045.707751:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1784185046.538875:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185047.564590:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185048.587606:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185049.610612:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185050.637399:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784185050.826674:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784185050.826684:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1784185051.660010:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185052.685496:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185053.706600:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185053.962467:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784185043/real 1784185043] req@ffff9b5fc1636680 x1870853265513088/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784185053 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185053.962515:0:3312:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b5fc1636680 x1870853265513088/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784185053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784185053.962534:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fbf642800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784185053.962554:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1870853265513088:0@lo:39:umount.0 00000100:00080000:1.0:1784185053.962702:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784185053.962707:0:13081:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784185053.962712:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784185053.963656:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963672:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963699:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963706:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963733:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784185053.963742:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963748:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963755:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963762:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185053.963787:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784185053.963792:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784185053.963812:0:13081:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784185053.963816:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784185053.963821:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784185053.963826:0:13081:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784185053.963831:0:13081:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b5fb93319c0) has no exports 00000020:00080000:1.0:1784185053.963853:0:13081:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b5fb93319c0) has no exports 00000020:01000000:1.0:1784185053.965461:0:13081:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5f90556c00 - data ffff9b5fb1c230d8/ffff9b5fb8d54800 00000020:01000000:1.0:1784185053.965615:0:13081:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b5fb7416780 - data ffff9b5fbfdbe438/ffff9b5fb8d56800 00010000:00010000:2.0:1784185053.966158:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185053.966168:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966233:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c200 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784185053.966239:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966248:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784185053.966255:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185053.966261:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784185053.966263:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1784185053.966267:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1784185053.966284:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b5f83f51800 00010000:00010000:2.0:1784185053.966288:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966295:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8affac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8affb3 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966308:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185053.966311:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966317:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f000 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:2.0:1784185053.966320:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966326:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784185053.966379:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185053.966384:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784185053.966387:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784185053.966389:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784185053.966396:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b5f83f51800 00010000:00010000:2.0:1784185053.966399:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966405:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f000/0x63160f6fbe8b01f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8b01f8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185053.966418:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185053.966419:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185053.966421:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185053.967089:0:7491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1784185053.976109:0:13081:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784185053.999705:0:13081:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afea2 00000020:00000080:2.0:1784185053.999716:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5fb933c800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1784185053.999739:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5fbfbf1800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1784185053.999743:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fbfbf1800 2 00000020:01000004:2.0:1784185053.999746:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b5fbfbf1800 from lustre-OST0001 00000020:00000080:2.0:1784185053.999770:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784185053.999780:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1784185053.999783:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5fb8140000/lustre-OST0001_UUID 00000020:00000080:2.0:1784185053.999786:0:13081:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb8140000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1784185053.999800:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1784185053.999924:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import dd3a63d1-a8e3-43ef-9771-5d6fc11873d7->MGS 00010000:00010000:2.0:1784185053.999940:0:13081:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fc00/0x63160f6fbe8afda6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8afdad expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784185053.999967:0:13081:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fc00/0x63160f6fbe8afda6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8afdad expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185053.999973:0:13081:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1784185053.999976:0:13081:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1784185053.999979:0:13081:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1784185053.999994:0:13081:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b5f83f51800 00010000:00010000:2.0:1784185053.999998:0:13081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fc00/0x63160f6fbe8afda6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8afdad expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185054.000012:0:13081:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x63160f6fbe8afff9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784185054.000018:0:13081:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x63160f6fbe8afff9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185054.000023:0:13081:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784185054.000025:0:13081:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1784185054.000027:0:13081:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1784185054.000036:0:13081:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b5f83f51800 00010000:00010000:2.0:1784185054.000039:0:13081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8164a000/0x63160f6fbe8afff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x63160f6fbe8afff9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784185054.000068:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9b5f83f51800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1784185054.000072:0:13081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784185054.000075:0:13081:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784185054.000076:0:13081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784185054.000080:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784185054.000090:0:13081:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b5fbfbcea00 x1870853265512960/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784185055 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784185054.000115:0:13081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784185054.000117:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:0.0:1784185054.000377:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb933c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1784185054.000412:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd3a63d1-a8e3-43ef-9771-5d6fc11873d7:3312:1870853265512960:0@lo:250:kworker.0 10000000:01000000:2.0:1784185054.001411:0:13081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784185054.001422:0:13081:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afc95 00000020:00000080:2.0:1784185054.001428:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5f844af000/dd3a63d1-a8e3-43ef-9771-5d6fc11873d7 00000020:01000000:2.0:1784185054.001439:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.129@tcp (flags='') 00000020:00000080:2.0:1784185054.001444:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784185054.001450:0:13081:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784185054.001453:0:13081:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9b5f90580000) has no exports 00000020:00000080:0.0:1784185054.001527:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f844af000/dd3a63d1-a8e3-43ef-9771-5d6fc11873d7 for MGC192.168.201.129@tcp 10000000:01000000:3.0:1784185054.001710:0:5789:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1784185054.001895:0:13081:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.129@tcp: client import never connected 00000100:00080000:2.0:1784185054.001899:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1784185054.001901:0:13081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784185054.001905:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1784185054.001906:0:13081:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784185054.001950:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784185054.001956:0:13081:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.129@tcp (uuid dd3a63d1-a8e3-43ef-9771-5d6fc11873d7) 00000020:01000000:2.0:1784185054.001961:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784185054.001965:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784185054.001968:0:13081:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784185054.001974:0:13081:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b5fb8cd4800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784185054.001980:0:13081:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9b5fb7228000) has exports, disconnecting them 00000020:00080000:2.0:1784185054.001984:0:13081:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b5fb8cd4800), last request at 1784184820 00000020:00000080:2.0:1784185054.001987:0:13081:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afecc 00000020:00080000:2.0:1784185054.001998:0:13081:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b5fb8cd4800): rc 0 00000020:00000080:2.0:1784185054.002002:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5fb8cd4800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784185054.005904:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5f83f51800 for MGC192.168.201.129@tcp 00000020:00000080:3.0:1784185054.005921:0:8:0:(genops.c:906:class_export_put()) final put ffff9b5f83f53800/dd3a63d1-a8e3-43ef-9771-5d6fc11873d7 00000020:00000080:3.0:1784185054.005924:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5f83f53800/dd3a63d1-a8e3-43ef-9771-5d6fc11873d7 for MGC192.168.201.129@tcp 00000020:01000000:3.0:1784185054.005933:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.129@tcp (dd3a63d1-a8e3-43ef-9771-5d6fc11873d7) 00000020:00000080:3.0:1784185054.006325:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb8cd4800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1784185054.008374:0:13081:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1784185054.008384:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784185054.008388:0:13081:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784185054.008410:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784185054.008576:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b5fbf642800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1784185054.009680:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1784185054.010551:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1784185054.012987:0:7491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1784185054.013232:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b5fb515b000:5775] 0 exiting: rc = 1 00000100:00100000:0.0:1784185054.013287:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b5fb515b200:5776] 1 exiting: rc = 0 00000100:00100000:3.0:1784185054.013449:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.013715:0:5778:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b5fb515a200:5778] 1 exiting: rc = 0 00000100:00100000:3.0:1784185054.013774:0:7492:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b5fc1626200:7492] 3 exiting: rc = 0 00000100:00100000:3.0:1784185054.013842:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b5fb515bc00:5777] 0 exiting: rc = 1 00000100:00100000:0.0:1784185054.019240:0:5779:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b5fb515be00:5779] 2 exiting: rc = 0 00000100:00100000:3.0:1784185054.019975:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.019987:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.019994:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020001:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020007:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020020:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020028:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020034:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020039:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020044:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020051:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020068:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020075:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020082:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020088:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020096:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020103:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020108:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020114:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020119:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020125:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020131:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020136:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020140:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020145:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020150:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020155:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020161:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020166:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020186:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020191:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020197:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020202:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020207:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020212:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020217:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020223:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020240:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020246:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020252:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020258:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020263:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020268:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020273:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020278:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020283:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020288:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020293:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020299:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020304:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020309:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020315:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020320:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020325:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020353:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020361:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020367:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020371:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020376:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020381:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020386:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020392:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020397:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.020410:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784185054.025117:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784185054.025133:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1784185054.025138:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5fb8cd2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1784185054.025145:0:13081:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fb8cd2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1784185054.025157:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1784185054.025217:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fbfbf1800 1 00000020:00000080:3.0:1784185054.025223:0:13081:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x63160f6fbe8afe71 00000020:00000080:3.0:1784185054.025243:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5fbfbf6000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1784185054.025254:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1784185054.025259:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784185054.025263:0:13081:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784185054.025267:0:13081:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9b5f844fb380) has no exports 00000020:00000080:0.0:1784185054.025693:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fbfbf6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1784185054.047541:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784185054.047556:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1784185054.047562:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5fbfbf0000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1784185054.047567:0:13081:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5fbfbf0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1784185054.047577:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1784185054.047767:0:13081:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b5fbfbf5800 00000020:01000000:3.0:1784185054.047787:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1784185054.047790:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784185054.047794:0:13081:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784185054.047797:0:13081:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9b5f844f8000) has no exports 00000020:00000080:3.0:1784185054.047819:0:13081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784185054.047825:0:13081:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1784185054.047828:0:13081:0:(genops.c:906:class_export_put()) final put ffff9b5faec50800/OSS_uuid 00000020:00000080:3.0:1784185054.047830:0:13081:0:(genops.c:865:class_export_destroy()) destroying export ffff9b5faec50800/OSS_uuid for OSS 00000020:01000000:3.0:1784185054.047834:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1784185054.047904:0:10137:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b5fc13a2a00:10137] 3 exiting: rc = 0 00000100:00100000:3.0:1784185054.047984:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b5f88834000:6588] 0 exiting: rc = 1 00000100:00100000:3.0:1784185054.048030:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b5faf275000:6589] 1 exiting: rc = 0 00000100:00100000:3.0:1784185054.048084:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b5faf274e00:6590] 2 exiting: rc = 0 00000100:00100000:3.0:1784185054.048141:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048160:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048167:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048173:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048178:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048183:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048188:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048193:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048198:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048204:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048209:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048214:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.048219:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049327:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049357:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049364:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049369:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049374:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049379:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049385:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049390:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049395:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049400:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049406:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049410:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049416:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049421:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049426:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049432:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049437:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049443:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049450:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049455:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049460:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049466:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049471:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049488:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049493:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049501:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049508:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049514:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049520:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049524:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049529:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049534:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049540:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049552:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049558:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049563:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049570:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049576:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049582:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049587:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049593:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049598:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049603:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049611:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049617:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049622:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049627:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049632:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049637:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049642:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.049647:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052021:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b5fb8f06200:6593] 1 exiting: rc = 0 00000100:00100000:0.0:1784185054.052468:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b5faf274a00:6592] 0 exiting: rc = 1 00000100:00100000:3.0:1784185054.052591:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052599:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052605:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052611:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052617:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052622:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052640:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052646:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052651:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052657:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052662:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052790:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052801:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052806:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052812:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052817:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052822:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052828:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052833:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052838:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052843:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052848:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052853:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052858:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052864:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052869:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052874:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052880:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052885:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052890:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052896:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052901:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052907:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052912:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052918:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052924:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052929:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052935:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052940:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052945:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052950:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052963:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052969:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052974:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052979:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052984:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052989:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.052994:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053000:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053005:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053010:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053015:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053020:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053025:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053030:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053035:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053040:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053045:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053050:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053068:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053074:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053079:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053084:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.053090:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:2.0:1784185054.053856:0:5788:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1784185054.054968:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b5fb8f07e00:6595] 1 exiting: rc = 0 00000100:00100000:0.0:1784185054.055150:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b5fb8f06000:6594] 0 exiting: rc = 1 00000100:00100000:3.0:1784185054.055636:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b5fb8f06c00:6596] 2 exiting: rc = 0 00000100:00100000:3.0:1784185054.055773:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055782:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055788:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055795:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055802:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055818:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055826:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055832:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055841:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055847:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055853:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055874:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055879:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055885:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055892:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055898:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055904:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055910:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055915:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055921:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055927:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055932:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055939:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055946:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055952:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055958:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055965:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055972:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055978:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.055985:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056007:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056015:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056021:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056028:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056034:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056039:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056046:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056052:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056071:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056078:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056083:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056088:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056094:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056099:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056105:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056111:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056125:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056131:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056136:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056141:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056146:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056152:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056158:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056164:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056170:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056176:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056196:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056203:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056209:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056217:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056294:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056303:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056308:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784185054.056328:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062254:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b5fb8f07c00:6597] 0 exiting: rc = 1 00000100:00100000:3.0:1784185054.062770:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b5fb8f07600:6598] 1 exiting: rc = 0 00000100:00100000:0.0:1784185054.062870:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062878:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062884:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062889:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062894:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062900:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062905:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062910:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062915:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062920:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062925:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062930:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062935:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062941:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062946:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062951:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062970:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062975:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062980:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062985:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062989:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.062994:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063000:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063005:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063010:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063015:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063019:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063024:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063029:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063034:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063039:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063044:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063049:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063067:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063074:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063079:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063085:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063089:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063095:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063102:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063107:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063112:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063117:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063123:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063130:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063134:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063139:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063143:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063148:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063152:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063157:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063171:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063176:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063181:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063186:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063191:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063196:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063200:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063205:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063209:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063213:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063218:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063222:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.063240:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064111:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b5faed4e400:6599] 0 exiting: rc = 1 00000100:00100000:0.0:1784185054.064186:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b5faed4e000:6600] 1 exiting: rc = 0 00000100:00100000:0.0:1784185054.064296:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064304:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064310:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064316:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064322:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064327:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064363:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064371:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064378:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064385:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064391:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064397:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064402:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064408:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064414:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064420:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064428:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064435:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064458:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064466:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064483:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064489:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064495:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064501:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064506:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064514:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064519:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064524:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064529:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064536:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064557:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064564:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064569:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064575:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064581:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064586:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064592:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064598:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064604:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064610:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064616:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064622:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064642:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064649:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064654:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064660:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064666:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064818:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064826:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064832:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064839:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064845:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064851:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064857:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064877:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064891:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064896:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064902:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064908:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064914:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064920:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064925:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064940:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784185054.064949:0:13081:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1784185054.072927:0:13081:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1784185072.292697:0:13698:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784185080.527439:0:14110:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784185080.527444:0:14110:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1784185080.527551:0:14110:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b5fbf5dc000 00000020:01000004:0.0:1784185080.527568:0:14110:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784185080.527576:0:14110:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784185080.527591:0:14110:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b5fb74c19c0) 00000020:00000080:0.0:1784185080.527605:0:14110:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784185080.539874:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1784185080.541837:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1784185080.542185:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 371: rc = 0 00100000:10000000:0.0:1784185080.542323:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 371: rc = 0 00100000:10000000:2.0:1784185080.542881:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784185080.542953:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 371: rc = 0 00100000:10000000:2.0:1784185080.543050:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 371: rc = 0 00100000:10000000:2.0:1784185080.543188:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 371: rc = 0 00100000:10000000:2.0:1784185080.543288:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 371: rc = 0 00100000:10000000:2.0:1784185080.543718:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 373: rc = 0 00100000:10000000:2.0:1784185080.544823:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 642: rc = 0 00100000:10000000:2.0:1784185080.544905:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 642: rc = 0 00100000:10000000:2.0:1784185080.545239:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 510: rc = 0 00100000:10000000:2.0:1784185080.545564:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 510: rc = 0 00100000:10000000:2.0:1784185080.547307:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 510: rc = 0 00100000:10000000:2.0:1784185080.547667:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 510: rc = 0 00100000:10000000:2.0:1784185080.547922:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 510: rc = 0 00100000:10000000:2.0:1784185080.548166:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 510: rc = 0 00100000:10000000:2.0:1784185080.548499:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 510: rc = 0 00100000:10000000:2.0:1784185080.548761:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 510: rc = 0 00100000:10000000:2.0:1784185080.549009:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 510: rc = 0 00100000:10000000:2.0:1784185080.549277:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 510: rc = 0 00100000:10000000:2.0:1784185080.549605:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 510: rc = 0 00100000:10000000:2.0:1784185080.549876:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 510: rc = 0 00100000:10000000:2.0:1784185080.550270:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 522: rc = 0 00100000:10000000:2.0:1784185080.550639:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 522: rc = 0 00100000:10000000:2.0:1784185080.553950:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 522: rc = 0 00100000:10000000:2.0:1784185080.554205:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 522: rc = 0 00100000:10000000:2.0:1784185080.554460:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 522: rc = 0 00100000:10000000:2.0:1784185080.554701:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 522: rc = 0 00100000:10000000:2.0:1784185080.554931:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 522: rc = 0 00100000:10000000:2.0:1784185080.555147:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 522: rc = 0 00100000:10000000:2.0:1784185080.555417:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 522: rc = 0 00100000:10000000:2.0:1784185080.555892:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 522: rc = 0 00100000:10000000:2.0:1784185080.556133:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 522: rc = 0 00100000:10000000:2.0:1784185080.556403:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 522: rc = 0 00100000:10000000:2.0:1784185080.556875:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 522: rc = 0 00100000:10000000:2.0:1784185080.557120:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 522: rc = 0 00100000:10000000:2.0:1784185080.557468:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 522: rc = 0 00100000:10000000:2.0:1784185080.557817:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 522: rc = 0 00100000:10000000:2.0:1784185080.558066:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 522: rc = 0 00100000:10000000:2.0:1784185080.558304:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 522: rc = 0 00100000:10000000:2.0:1784185080.558720:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 522: rc = 0 00100000:10000000:2.0:1784185080.559039:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 522: rc = 0 00100000:10000000:2.0:1784185080.559541:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 522: rc = 0 00100000:10000000:2.0:1784185080.559824:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 522: rc = 0 00100000:10000000:2.0:1784185080.560090:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 522: rc = 0 00100000:10000000:2.0:1784185080.560360:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 522: rc = 0 00100000:10000000:2.0:1784185080.560613:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 522: rc = 0 00100000:10000000:2.0:1784185080.560872:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 522: rc = 0 00100000:10000000:2.0:1784185080.561118:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 522: rc = 0 00100000:10000000:2.0:1784185080.561400:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 522: rc = 0 00100000:10000000:2.0:1784185080.561651:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 522: rc = 0 00100000:10000000:2.0:1784185080.561874:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 522: rc = 0 00100000:10000000:2.0:1784185080.562138:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 522: rc = 0 00100000:10000000:2.0:1784185080.562414:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 522: rc = 0 00100000:10000000:2.0:1784185080.563073:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 779: rc = 0 00100000:10000000:2.0:1784185080.563678:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1784185080.563861:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:2.0:1784185080.564070:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1784185080.564144:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:2.0:1784185080.564459:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1784185080.564539:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:2.0:1784185080.564969:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1784185080.565037:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 517: rc = 0 00100000:10000000:2.0:1784185080.565235:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1784185080.565305:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 517: rc = 0 00100000:10000000:2.0:1784185080.565523:0:14110:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1784185080.565683:0:14110:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 517: rc = 0 00000020:00000080:2.0:1784185080.565937:0:14110:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784185080.565945:0:14110:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784185080.565956:0:14110:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8b0f96 00000020:01000004:2.0:1784185080.565963:0:14110:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1784185080.565968:0:14110:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784185080.565973:0:14110:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b5fbf5dc000 from MGS 00000020:01000004:2.0:1784185080.565976:0:14110:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784185080.565986:0:14110:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b5fb72299c0) 00000020:00000080:2.0:1784185080.565994:0:14110:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784185080.566046:0:14110:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fbf5dc000 from MGS, refs=2 00080000:01000000:2.0:1784185080.566050:0:14110:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784185080.566055:0:14110:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8b0fa4 00000100:00100000:2.0:1784185080.566149:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784185080.566267:0:14110:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784185080.566274:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784185080.566849:0:14110:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784185080.566858:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784185080.567505:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784185080.567703:0:14110:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784185080.567708:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784185080.568081:0:14110:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784185080.568087:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784185080.568549:0:14110:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784185080.568556:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784185080.569207:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185080.569211:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185080.569212:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185080.569522:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185080.569524:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185080.569525:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185080.570268:0:14110:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784185080.571681:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1784185080.579844:0:14110:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1784185080.579859:0:14110:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784185080.579861:0:14110:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1784185080.584735:0:14120:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784185080.584927:0:14110:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784185080.585104:0:14110:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784185080.586110:0:14110:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784185080.586627:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784185080.586774:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784185080.586779:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784185080.587070:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784185080.587077:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784185080.587245:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784185080.587250:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1784185080.588049:0:14124:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1784185080.588161:0:14110:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784185080.588180:0:14110:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:2.0:1784185080.588182:0:14110:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784185080.588210:0:14110:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:2.0:1784185080.588221:0:14110:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (ffff9b5fb722b380) 00000020:00000080:2.0:1784185080.588235:0:14110:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784185080.588304:0:14110:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5e813e7800@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1784185080.588528:0:14110:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:2.0:1784185080.588534:0:14110:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 10000000:01000000:2.0:1784185080.589371:0:14125:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1784185080.589484:0:14110:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid d2cf958e-f219-4c8a-8fdf-735d6ed095ff) 00000020:00000080:0.0:1784185080.589503:0:14110:0:(genops.c:1406:class_connect()) connect: client d2cf958e-f219-4c8a-8fdf-735d6ed095ff, cookie 0x63160f6fbe8b0fb2 00000100:00080000:0.0:1784185080.589514:0:14110:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784185080.589521:0:14110:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9b5e813e7800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1784185080.589550:0:14110:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5faf056d80 x1870853265513216/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784185080.589592:0:14110:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d2cf958e-f219-4c8a-8fdf-735d6ed095ff->MGS 00000020:01000004:0.0:1784185080.589629:0:14110:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784185080.589634:0:14110:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1784185080.589646:0:14110:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b5fb74c0000) 00000020:00000080:0.0:1784185080.589655:0:14110:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784185080.589691:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3312:1870853265513216:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784185080.589754:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.589862:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265513216 00000100:00100000:3.0:1784185080.589870:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265513216 00000100:00100000:3.0:1784185080.589902:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784185080.589909:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1870853265513216:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1784185080.589930:0:14121:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d2cf958e-f219-4c8a-8fdf-735d6ed095ff@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1784185080.589948:0:14121:0:(genops.c:1406:class_connect()) connect: client d2cf958e-f219-4c8a-8fdf-735d6ed095ff, cookie 0x63160f6fbe8b0fc0 00000100:00080000:3.0:1784185080.590045:0:14121:0:(import.c:65:import_set_state_nolock()) ffff9b5fb506e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784185080.590099:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+5:3312:x1870853265513216:12345-0@lo:250:mount.lustre.0 Request processed in 189us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185080.590105:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784185080.590177:0:3312:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784185080.590185:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:2.0:1784185080.590191:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784185080.590194:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784185080.590197:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5e813e7800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784185080.590199:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784185080.590211:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784185080.590216:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3312:1870853265513216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784185080.597391:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784185080.597555:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784185080.597562:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784185080.602771:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784185080.602786:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784185080.603190:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784185080.603196:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784185080.604068:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784185080.604239:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784185080.604245:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784185080.604921:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784185080.604928:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784185080.640509:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185080.640740:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784185080.640747:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784185080.641746:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784185080.641755:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784185080.644001:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185080.644201:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784185080.644207:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784185080.644809:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784185080.644815:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784185080.645308:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185080.645582:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784185080.645587:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784185080.645995:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784185080.646001:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784185080.646684:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185080.646812:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784185080.646817:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784185080.647285:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784185080.647291:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1784185080.660637:0:14110:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185080.660825:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784185080.660831:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1784185080.663116:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784185080.663130:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784185080.664294:0:14110:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784185080.664305:0:14110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784185080.665133:0:14110:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784185080.665157:0:14110:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784185080.665164:0:14110:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784185080.665447:0:14110:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784185080.665482:0:14110:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784185080.665487:0:14110:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784185080.665489:0:14110:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784185080.665490:0:14110:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784185080.665492:0:14110:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784185080.665496:0:14110:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784185080.665498:0:14110:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784185080.665499:0:14110:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784185080.665501:0:14110:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784185080.665502:0:14110:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784185080.665504:0:14110:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784185080.665506:0:14110:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784185080.665508:0:14110:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784185080.665509:0:14110:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784185080.665511:0:14110:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784185080.665512:0:14110:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784185080.665513:0:14110:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784185080.665514:0:14110:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784185080.665515:0:14110:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784185080.665516:0:14110:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784185080.665517:0:14110:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784185080.665518:0:14110:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784185080.665542:0:14110:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784185080.665559:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784185080.665673:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.665763:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f90287a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784185080.665858:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265513344 00000100:00100000:3.0:1784185080.665865:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265513344 00000100:00100000:3.0:1784185080.665955:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784185080.665965:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+5:14110:x1870853265513344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784185080.666003:0:14123:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784185080.666007:0:14123:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784185080.666009:0:14123:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1784185080.666267:0:14144:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784185080.666748:0:14123:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1784185080.668076:0:14145:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784185080.668083:0:14145:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784185080.668086:0:14145:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784185080.668120:0:14145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1784185080.668523:0:14123:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784185080.668532:0:14123:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784185080.677242:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+5:14110:x1870853265513344:12345-0@lo:253:mount.lustre.0 Request processed in 11266us (11557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.677281:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784185080.677561:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784185080.677577:0:14110:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784185080.677581:0:14110:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784185080.677663:0:14110:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784185080.677665:0:14110:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784185080.677666:0:14110:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784185080.677668:0:14110:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784185080.677669:0:14110:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784185080.677670:0:14110:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784185080.677672:0:14110:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784185080.677674:0:14110:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784185080.677675:0:14110:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784185080.677700:0:14110:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b5fbf5dc000 from lustre-MDT0000 10000000:01000000:2.0:1784185080.677723:0:14110:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784185080.677727:0:14110:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784185080.677731:0:14110:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b5fb722b380 10000000:01000000:2.0:1784185080.677735:0:14110:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784185080.677743:0:14110:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b5fb722b380 from 1 10000000:01000000:2.0:1784185080.677746:0:14110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784185080.677780:0:14110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.677791:0:14110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.677802:0:14110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185080.677822:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784185080.677856:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.677946:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fa4d68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.677987:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265513472 00000100:00100000:0.0:1784185080.677993:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265513472 00000100:00100000:0.0:1784185080.678035:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784185080.678043:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+5:14110:x1870853265513472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784185080.678062:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185080.678076:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8b0fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0fc7 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.678100:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8b0fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0fc7 expref: 6 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.678111:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d800/0x63160f6fbe8b0fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0fc7 expref: 6 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.678119:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d800, rc 0) 00000100:00100000:0.0:1784185080.678245:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+6:14110:x1870853265513472:12345-0@lo:101:mount.lustre.0 Request processed in 202us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.678251:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784185080.678316:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185080.678399:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.678408:0:14110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185080.678457:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185080.678484:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.678513:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fa4d68cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.678570:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265513600 00000100:00100000:1.0:1784185080.678575:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265513600 00000100:00100000:1.0:1784185080.678629:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784185080.678636:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+6:14110:x1870853265513600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784185080.678879:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+6:14110:x1870853265513600:12345-0@lo:501:mount.lustre.0 Request processed in 243us (393us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784185080.678886:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784185080.679090:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513600:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784185080.679113:0:14110:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784185080.679134:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.679143:0:14110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185080.679151:0:14110:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b5fbf5dc000 10000000:01000000:2.0:1784185080.679155:0:14110:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784185080.679159:0:14110:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b5fbf5dc000 10000000:01000000:2.0:1784185080.679162:0:14110:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784185080.679165:0:14110:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b5fbf5dc000 from 1 10000000:01000000:2.0:1784185080.679167:0:14110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784185080.679184:0:14110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d400/0x63160f6fbe8b0fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.679192:0:14110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d400/0x63160f6fbe8b0fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.679202:0:14110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d400/0x63160f6fbe8b0fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185080.679214:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784185080.679241:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.679257:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fa4d68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.679313:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265513728 00000100:00100000:0.0:1784185080.679318:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265513728 00000100:00100000:0.0:1784185080.679367:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185080.679374:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+6:14110:x1870853265513728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784185080.679381:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185080.679392:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8b0fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0fd5 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.679407:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8b0fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0fd5 expref: 7 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.679416:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d600/0x63160f6fbe8b0fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0fd5 expref: 7 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.679423:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d600, rc 0) 00000100:00100000:0.0:1784185080.679461:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+7:14110:x1870853265513728:12345-0@lo:101:mount.lustre.0 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.679467:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784185080.679560:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185080.679571:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d400/0x63160f6fbe8b0fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fdc expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.679599:0:14110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d400/0x63160f6fbe8b0fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0fdc expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185080.679610:0:14110:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784185080.679624:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d400/0x63160f6fbe8b0fd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fdc expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.679631:0:14110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d400/0x63160f6fbe8b0fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fdc expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185080.679636:0:14110:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784185080.679639:0:14110:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784185080.679643:0:14110:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b5fbf5dc000 10000000:01000000:2.0:1784185080.679646:0:14110:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784185080.679648:0:14110:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784185080.679650:0:14110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784185080.679665:0:14110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d000/0x63160f6fbe8b0fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.679672:0:14110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d000/0x63160f6fbe8b0fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.679679:0:14110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d000/0x63160f6fbe8b0fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185080.679691:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784185080.679714:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.679733:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fa4d68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.679838:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265513856 00000100:00100000:0.0:1784185080.679842:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265513856 00000100:00100000:0.0:1784185080.679863:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784185080.679868:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+7:14110:x1870853265513856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784185080.679875:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185080.679884:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631ca00/0x63160f6fbe8b0fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b0fe3 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.679897:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631ca00/0x63160f6fbe8b0fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b0fe3 expref: 8 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.679905:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631ca00/0x63160f6fbe8b0fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b0fe3 expref: 8 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.679912:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ca00, rc 0) 00000100:00100000:0.0:1784185080.679945:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+8:14110:x1870853265513856:12345-0@lo:101:mount.lustre.0 Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.679951:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784185080.680015:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185080.680026:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d000/0x63160f6fbe8b0fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fea expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.680034:0:14110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d000/0x63160f6fbe8b0fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b0fea expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185080.680067:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185080.680092:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.680115:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fa4d68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.680158:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265513984 00000100:00100000:0.0:1784185080.680162:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265513984 00000100:00100000:0.0:1784185080.680184:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784185080.680190:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+8:14110:x1870853265513984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784185080.680533:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14110:x1870853265513984:12345-0@lo:501:mount.lustre.0 Request processed in 343us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.680541:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784185080.680829:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265513984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185080.680859:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265514112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784185080.680894:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.680915:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fa4d68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.680966:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265514112 00000100:00100000:0.0:1784185080.680972:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265514112 00000100:00100000:0.0:1784185080.681004:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784185080.681010:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14110:x1870853265514112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185080.681323:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14110:x1870853265514112:12345-0@lo:503:mount.lustre.0 Request processed in 312us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.681352:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784185080.681493:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265514112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185080.681902:0:14146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14146:1870853265514240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784185080.681940:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185080.682005:0:14146:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92840 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.682103:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265514240 00000100:00100000:1.0:1784185080.682109:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265514240 00000100:00100000:1.0:1784185080.682174:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784185080.682182:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14146:x1870853265514240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784185080.682464:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14146:x1870853265514240:12345-0@lo:502:llog_process_th.0 Request processed in 282us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.682471:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784185080.682564:0:14146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14146:1870853265514240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784185080.682598:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784185080.682609:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185080.682611:0:14146:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784185080.682629:0:14146:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784185080.682632:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784185080.682646:0:14146:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b5fb722cd40) 00000020:00000080:2.0:1784185080.682664:0:14146:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784185080.682668:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784185080.682735:0:14146:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784185080.682741:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8b0ff8 00000020:00000080:2.0:1784185080.682942:0:14146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784185080.682952:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784185080.682955:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185080.682956:0:14146:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784185080.682959:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784185080.682962:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185080.682964:0:14146:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784185080.682967:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784185080.682973:0:14146:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b5fb7228000) 00000020:00000080:2.0:1784185080.682982:0:14146:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784185080.682986:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784185080.682987:0:14146:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784185080.682990:0:14146:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784185080.682995:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784185080.683030:0:14146:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fbf5dc000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784185080.683041:0:14146:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b5f844f8000) 00000020:00000080:2.0:1784185080.683048:0:14146:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784185080.683089:0:14146:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784185080.683094:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8b100d 00000020:00000080:2.0:1784185080.683181:0:14146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784185080.683186:0:14146:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784185080.683190:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x63160f6fbe8b1014 00080000:01000000:2.0:1784185080.683195:0:14146:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784185080.683198:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8b101b 00010000:00010000:2.0:1784185080.729821:0:14146:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784185080.730246:0:14146:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1784185080.730683:0:14146:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784185080.731480:0:14146:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b5f844fb380) 00000020:00000080:2.0:1784185080.731499:0:14146:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784185080.731558:0:14146:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784185080.731564:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8b1029 00000020:00000080:1.0:1784185080.734091:0:14146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784185080.737543:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x63160f6fbe8b1030 00000020:00000080:2.0:1784185080.742982:0:14146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784185080.742995:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185080.743064:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.743067:0:14146:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784185080.743072:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185080.743079:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.743081:0:14146:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784185080.743085:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784185080.743130:0:14146:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784185080.743146:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185080.743149:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.743151:0:14146:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784185080.743154:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784185080.743155:0:14146:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1784185080.743157:0:14146:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784185080.743158:0:14146:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784185080.743159:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784185080.743162:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.743163:0:14146:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784185080.743165:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784185080.743168:0:14146:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784185080.743171:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.743172:0:14146:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784185080.743183:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784185080.743189:0:14146:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:0.0:1784185080.743215:0:14146:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784185080.743218:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784185080.743232:0:14146:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b5fb74c3380) 00000020:00000080:0.0:1784185080.743250:0:14146:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1784185080.743255:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784185080.743314:0:14146:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784185080.743320:0:14146:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784185080.743327:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8b103e 00010000:00080000:0.0:1784185080.743390:0:14146:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5fb7d97000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1784185080.743761:0:14146:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1784185080.744157:0:14146:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784185080.744203:0:14146:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784185080.745283:0:14146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784185080.745548:0:14146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1784185080.745771:0:14146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1784185080.746115:0:14150:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784185080.746119:0:14150:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784185080.746951:0:14146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784185080.746965:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784185080.746995:0:14146:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784185080.747015:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8b1045 00000100:00080000:0.0:1784185080.747025:0:14146:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784185080.747031:0:14146:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b5fb7d97000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1784185080.747065:0:14146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5faf055f80 x1870853265514368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784185080.747134:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265514368:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784185080.747188:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870853265514368 offset 0 length 520: 4 00000100:00080000:0.0:1784185080.747258:0:14146:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784185080.747379:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185080.747383:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.747385:0:14146:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784185080.747388:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784185080.747398:0:14146:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1784185080.747399:0:14146:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784185080.747401:0:14146:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784185080.747403:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784185080.747406:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.747408:0:14146:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784185080.747410:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784185080.747415:0:14146:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784185080.747418:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.747420:0:14146:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784185080.747422:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784185080.747426:0:14146:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:0.0:1784185080.747445:0:14146:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784185080.747448:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784185080.747459:0:14146:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b5fb74c4d40) 00000020:00000080:0.0:1784185080.747471:0:14146:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1784185080.747476:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784185080.747535:0:14146:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784185080.747541:0:14146:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784185080.747547:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x63160f6fbe8b1053 00010000:00080000:0.0:1784185080.747671:0:14146:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5fb7d95000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1784185080.747872:0:14146:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1784185080.748053:0:14146:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784185080.748076:0:14146:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784185080.748888:0:14146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784185080.748974:0:14146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784185080.749033:0:14146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1784185080.749832:0:14152:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784185080.749837:0:14152:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784185080.750503:0:14146:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784185080.750517:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784185080.750548:0:14146:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784185080.750566:0:14146:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8b105a 00000100:00080000:0.0:1784185080.750575:0:14146:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784185080.750675:0:14146:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b5fb7d95000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1784185080.750711:0:14146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5faf054380 x1870853265514496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784185080.750781:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265514496:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784185080.750837:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870853265514496 offset 0 length 520: 4 00000100:00080000:0.0:1784185080.750904:0:14146:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784185080.750963:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185080.750968:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.750969:0:14146:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784185080.750972:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185080.750976:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.750977:0:14146:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784185080.750980:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784185080.750981:0:14146:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784185080.750984:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185080.750986:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.750987:0:14146:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784185080.750989:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185080.750992:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.750993:0:14146:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784185080.750997:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784185080.751026:0:14146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14146:1870853265514624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784185080.751081:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185080.751115:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265514624 00000100:00100000:0.0:1784185080.751121:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265514624 00000100:00100000:0.0:1784185080.751158:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784185080.751167:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14146:x1870853265514624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784185080.751432:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14146:x1870853265514624:12345-0@lo:502:llog_process_th.0 Request processed in 265us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.751440:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784185080.751485:0:14146:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.751507:0:14146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14146:1870853265514624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784185080.751538:0:14146:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185080.751542:0:14146:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185080.751544:0:14146:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784185080.751547:0:14146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1784185080.751915:0:14110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1784185080.751934:0:14110:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784185080.751988:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d000/0x63160f6fbe8b0fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fea expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.751999:0:14110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fc158d000/0x63160f6fbe8b0fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fea expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185080.752008:0:14110:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5fbf5dc000 from 1 10000000:01000000:2.0:1784185080.752010:0:14110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784185080.752038:0:14110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.752046:0:14110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.752054:0:14110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185080.752072:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265514752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784185080.752106:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185080.752143:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc1834180 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.752199:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265514752 00000100:00100000:1.0:1784185080.752205:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265514752 00000100:00100000:1.0:1784185080.752245:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784185080.752252:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+9:14110:x1870853265514752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784185080.752262:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185080.752277:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b1061 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.752311:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 10 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.752321:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 10 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.752345:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9000, rc 0) 00000100:00100000:1.0:1784185080.752387:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+10:14110:x1870853265514752:12345-0@lo:101:mount.lustre.0 Request processed in 136us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.752393:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784185080.752485:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265514752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784185080.752501:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.752509:0:14110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185080.753043:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265514880:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784185080.753096:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.753134:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88aa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.753280:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265514880 00000100:00100000:1.0:1784185080.753286:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265514880 00000100:00100000:1.0:1784185080.753315:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784185080.753322:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+10:14110:x1870853265514880:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784185080.753369:0:14122:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784185080.753375:0:14122:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784185080.753450:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+10:14110:x1870853265514880:12345-0@lo:256:mount.lustre.0 Request processed in 128us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.753458:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784185080.753669:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265514880:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784185080.754263:0:14110:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784185080.754537:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.754562:0:14110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185080.754742:0:14110:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbf5dc000 from 1 10000000:01000000:1.0:1784185080.754747:0:14110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784185080.754784:0:14110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.754792:0:14110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.754802:0:14110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185080.754829:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784185080.754881:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185080.754969:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784185080.755026:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515008 00000100:00100000:2.0:1784185080.755032:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515008 00000100:00100000:2.0:1784185080.755109:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784185080.755118:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+10:14110:x1870853265515008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185080.755129:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185080.755144:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b106f expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.755168:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 11 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.755178:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 11 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185080.755188:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fc158d200, rc 0) 00000100:00100000:2.0:1784185080.755248:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14110:x1870853265515008:12345-0@lo:101:mount.lustre.0 Request processed in 132us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185080.755255:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784185080.755368:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784185080.755383:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.755392:0:14110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185080.755448:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185080.755476:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.755903:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88aa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.755972:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515136 00000100:00100000:1.0:1784185080.755977:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515136 00000100:00100000:1.0:1784185080.756003:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784185080.756009:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14110:x1870853265515136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784185080.756474:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14110:x1870853265515136:12345-0@lo:501:mount.lustre.0 Request processed in 464us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.756482:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784185080.756709:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185080.756751:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784185080.756793:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.756823:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88aa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.756875:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515264 00000100:00100000:1.0:1784185080.756880:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515264 00000100:00100000:1.0:1784185080.756902:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784185080.756909:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14110:x1870853265515264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784185080.757052:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14110:x1870853265515264:12345-0@lo:503:mount.lustre.0 Request processed in 143us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.757059:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784185080.757133:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784185080.757564:0:14154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14154:1870853265515392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784185080.757685:0:14154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.757715:0:14154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88aa8540 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.757764:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515392 00000100:00100000:1.0:1784185080.757769:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515392 00000100:00100000:1.0:1784185080.757805:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784185080.757811:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14154:x1870853265515392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784185080.758006:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14154:x1870853265515392:12345-0@lo:502:llog_process_th.0 Request processed in 195us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.758013:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784185080.758136:0:14154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14154:1870853265515392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784185080.758161:0:14154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784185080.758176:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185080.758178:0:14154:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784185080.758186:0:14154:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fbf5dc000 00000020:00000080:3.0:1784185080.758189:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784185080.758197:0:14154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784185080.758200:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185080.758201:0:14154:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784185080.758204:0:14154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784185080.758206:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185080.758208:0:14154:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784185080.758211:0:14154:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fbf5dc000 00000020:00000080:3.0:1784185080.758212:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784185080.758270:0:14154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784185080.758273:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185080.758275:0:14154:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784185080.758278:0:14154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784185080.758280:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185080.758281:0:14154:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784185080.758285:0:14154:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b5fbf5dc000 00000020:00000080:3.0:1784185080.758287:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784185080.758326:0:14154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14154:1870853265515520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784185080.758396:0:14154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.758413:0:14154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88aa8540 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.759722:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515520 00000100:00100000:1.0:1784185080.759738:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515520 00000100:00100000:1.0:1784185080.759783:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784185080.759791:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14154:x1870853265515520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784185080.760000:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14154:x1870853265515520:12345-0@lo:502:llog_process_th.0 Request processed in 208us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.760007:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784185080.760745:0:14154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14154:1870853265515520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784185080.760780:0:14154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784185080.760788:0:14154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185080.760790:0:14154:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784185080.760795:0:14154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784185080.760996:0:14110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1784185080.761014:0:14110:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784185080.761029:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.761040:0:14110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185080.761084:0:14110:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784185080.761088:0:14110:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b5fbf5dc000 10000000:01000000:1.0:1784185080.761091:0:14110:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b5fbf5dc000 10000000:01000000:1.0:1784185080.761095:0:14110:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784185080.761101:0:14110:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fbf5dc000 from 1 10000000:01000000:1.0:1784185080.761103:0:14110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784185080.761134:0:14110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8200/0x63160f6fbe8b107d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.761143:0:14110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8200/0x63160f6fbe8b107d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.761152:0:14110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8200/0x63160f6fbe8b107d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185080.761172:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784185080.761225:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185080.761256:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.761272:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515648 00000100:00100000:1.0:1784185080.761277:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515648 00000100:00100000:1.0:1784185080.761303:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784185080.761310:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14110:x1870853265515648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784185080.761321:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185080.761354:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd9600/0x63160f6fbe8b1084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b107d expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.761379:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd9600/0x63160f6fbe8b1084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b107d expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.761391:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd9600/0x63160f6fbe8b1084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b107d expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.761400:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9600, rc 0) 00000100:00100000:1.0:1784185080.761436:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14110:x1870853265515648:12345-0@lo:101:mount.lustre.0 Request processed in 125us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.761442:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784185080.761476:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784185080.761488:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8200/0x63160f6fbe8b107d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1084 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.761497:0:14110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8200/0x63160f6fbe8b107d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b1084 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185080.762757:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784185080.762818:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185080.762855:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fc165cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784185080.763726:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515776 00000100:00100000:3.0:1784185080.763734:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515776 00000100:00100000:3.0:1784185080.763778:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784185080.763787:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14110:x1870853265515776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185080.764062:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14110:x1870853265515776:12345-0@lo:501:mount.lustre.0 Request processed in 275us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185080.764070:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784185080.764417:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784185080.764464:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185080.764507:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185080.764536:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784185080.764685:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265515904 00000100:00100000:3.0:1784185080.764691:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265515904 00000100:00100000:3.0:1784185080.764716:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784185080.764723:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14110:x1870853265515904:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784185080.764869:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14110:x1870853265515904:12345-0@lo:503:mount.lustre.0 Request processed in 146us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185080.764875:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784185080.764951:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265515904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784185080.777537:0:14156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14156:1870853265516032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784185080.777704:0:14156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.779944:0:14156:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f812eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.787714:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516032 00000100:00100000:0.0:1784185080.787729:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516032 00000100:00100000:0.0:1784185080.787790:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784185080.787801:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14156:x1870853265516032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784185080.788097:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14156:x1870853265516032:12345-0@lo:502:llog_process_th.0 Request processed in 298us (10393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.788106:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784185080.788174:0:14156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14156:1870853265516032:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784185080.788249:0:14156:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784185080.788273:0:14156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b5fbc0f3380) 00000020:00000080:0.0:1784185080.788292:0:14156:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1784185080.794020:0:14156:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fbf5dc000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784185080.794027:0:14156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5fbf5dc000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784185080.794030:0:14156:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fbf5dc000 4 00010000:00080000:0.0:1784185080.794071:0:14156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5fb74ab000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1784185080.795772:0:14156:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1784185080.795875:0:14156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784185080.795921:0:14156:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784185080.795935:0:14156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x63160f6fbe8b1092 00000100:00080000:0.0:1784185080.795945:0:14156:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784185080.795951:0:14156:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b5fb74ab000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1784185080.796002:0:14156:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5faf056d80 x1870853265516160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784185080.796033:0:14156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784185080.796071:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265516160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784185080.796137:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185080.796213:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516160 00000100:00100000:0.0:1784185080.796220:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516160 00000100:00100000:0.0:1784185080.796250:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784185080.796257:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1870853265516160:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784185080.796308:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1870853265516160:12345-0@lo:38:llog_process_th.0 Request processed in 50us (170us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784185080.796316:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784185080.796380:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784185080.796389:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784185080.796393:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784185080.796396:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265516160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784185080.799030:0:14156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14156:1870853265516288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784185080.799114:0:14156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.799152:0:14156:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f812edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784185080.799668:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516288 00000100:00100000:0.0:1784185080.799676:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516288 00000100:00100000:0.0:1784185080.799727:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784185080.799736:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14156:x1870853265516288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784185080.799988:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14156:x1870853265516288:12345-0@lo:502:llog_process_th.0 Request processed in 252us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185080.800006:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784185080.800109:0:14156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14156:1870853265516288:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784185080.800136:0:14156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784185080.802738:0:14110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784185080.802778:0:14110:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784185080.802797:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8200/0x63160f6fbe8b107d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1084 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.802811:0:14110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8200/0x63160f6fbe8b107d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1084 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784185080.802873:0:14110:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784185080.802876:0:14110:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784185080.802877:0:14110:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784185080.802878:0:14110:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784185080.802879:0:14110:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784185080.802880:0:14110:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784185080.802882:0:14110:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784185080.802883:0:14110:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784185080.802885:0:14110:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784185080.802887:0:14110:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784185080.802891:0:14110:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784185080.802894:0:14110:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784185080.802895:0:14110:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784185080.802896:0:14110:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784185080.802898:0:14110:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784185080.802899:0:14110:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784185080.802900:0:14110:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784185080.802901:0:14110:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784185080.802902:0:14110:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784185080.802903:0:14110:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784185080.802904:0:14110:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784185080.802934:0:14110:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784185080.802955:0:14110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265516416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784185080.803021:0:14110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185080.803059:0:14110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92000 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.803161:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516416 00000100:00100000:1.0:1784185080.803169:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516416 00000100:00100000:1.0:1784185080.803221:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784185080.803231:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14110:x1870853265516416:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784185080.803258:0:14122:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784185080.803272:0:14122:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784185080.876110:0:14122:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784185080.876160:0:14122:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784185080.877998:0:14144:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784185080.878007:0:14144:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784185080.878033:0:14144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.878052:0:14144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.878060:0:14144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.878111:0:14144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.878126:0:14144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 12 pid: 14121 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185080.878142:0:14144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14144:1870853265516544:0@lo:104: 00000100:00100000:3.0:1784185080.878211:0:14144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.878391:0:14144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784185080.878806:0:14111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516544 00000100:00100000:1.0:1784185080.878814:0:14111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516544 00000100:00100000:1.0:1784185080.878990:0:14111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784185080.879000:0:14111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14144:x1870853265516544:12345-0@lo:104: 00010000:00010000:1.0:1784185080.879014:0:14111:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185080.879129:0:14111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784185080.879135:0:14111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14144:x1870853265516544:12345-0@lo:104: Request processed in 138us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.879143:0:14111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784185080.879152:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185080.879159:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.879167:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c800 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784185080.879170:0:14117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.879180:0:14117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784185080.879187:0:14117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185080.879192:0:14117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1784185080.879208:0:14144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14144:1870853265516544:0@lo:104: 00010000:00010000:0.0:1784185080.879231:0:14117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.879237:0:14117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784185080.879258:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.879266:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c800/0x63160f6fbe8b1061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1068 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185080.879282:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185080.879284:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185080.879285:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185080.879307:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265516672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784185080.879314:0:14144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185080.879360:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185080.879572:0:14113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516672 00000100:00100000:3.0:1784185080.879577:0:14113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516672 00010000:00010000:3.0:1784185080.879606:0:14113:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 13 pid: 14121 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185080.879647:0:14113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784185080.879654:0:14113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+13:3316:x1870853265516672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784185080.879665:0:14113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185080.879670:0:14113:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 13 pid: 14121 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879681:0:14113:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 13 pid: 14121 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879696:0:14113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5fbfbd9000/0x63160f6fbe8b1068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b1061 expref: 13 pid: 14121 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879716:0:14113:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879724:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784185080.879739:0:14113:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001732816s 00010000:00010000:3.0:1784185080.879743:0:14113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879750:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879757:0:14113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879764:0:14113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879770:0:14113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fe00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784185080.879774:0:14113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879782:0:14113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879796:0:14113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879805:0:14113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185080.879840:0:14113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:3316:x1870853265516672:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185080.879846:0:14113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784185080.879863:0:14144:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879870:0:14144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185080.879876:0:14144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896fe00/0x63160f6fbe8b1099 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185080.880427:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265516672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784185080.883899:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14110:x1870853265516416:12345-0@lo:253:mount.lustre.0 Request processed in 80659us (80867us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185080.883915:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784185080.884481:0:14110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14110:1870853265516416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784185080.884498:0:14110:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784185080.884502:0:14110:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784185080.884503:0:14110:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784185080.884504:0:14110:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784185080.884505:0:14110:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784185080.884506:0:14110:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784185080.884507:0:14110:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784185080.884508:0:14110:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784185080.884509:0:14110:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784185080.884510:0:14110:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784185080.884511:0:14110:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784185080.884524:0:14110:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1784185080.893990:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1784185080.894106:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784185080.894314:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1784185080.894491:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784185080.894737:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1784185080.894851:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1784185080.899186:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1784185080.899315:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1784185080.899699:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1784185080.899867:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1784185080.900034:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1784185080.900133:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1784185080.931832:0:14110:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1784185080.932163:0:14110:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784185080.932447:0:14166:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784185080.932451:0:14166:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1784185080.932554:0:14167:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1784185080.932658:0:14167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784185080.934868:0:14167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784185080.934945:0:14167:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784185080.934949:0:14167:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1784185080.938139:0:14110:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784185080.938456:0:14110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784185080.939033:0:14110:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784185080.939565:0:14110:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784185080.939881:0:14110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784185080.941030:0:14110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784185080.944861:0:14110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784185080.944948:0:14110:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1784185080.946997:0:14110:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1784185080.952591:0:14110:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1784185080.983527:0:14110:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784185080.983567:0:14110:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac49c0c8f988 00100000:10000000:3.0:1784185080.983575:0:14110:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1784185080.984376:0:14110:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784185080.984393:0:14110:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784185080.984407:0:14110:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784185080.984436:0:14110:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1784185081.610567:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784185081.868149:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1784185081.994828:0:14125:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784185081.994836:0:14125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5fbf5dc000 from 6 10000000:01000000:3.0:1784185081.994841:0:14125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784185081.996089:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185081.996119:0:14125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185081.996132:0:14125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185081.996159:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265516800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784185081.996225:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185081.996280:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8c000 going to sleep for 11 seconds 00000100:00100000:0.0:1784185081.996430:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516800 00000100:00100000:0.0:1784185081.996439:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516800 00000100:00100000:0.0:1784185081.996489:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784185081.996498:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14125:x1870853265516800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784185081.996512:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185081.996527:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b10a0 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185081.997292:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185081.997310:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185081.997320:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d400, rc 0) 00000100:00100000:0.0:1784185081.997419:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265516800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 921us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185081.997427:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784185081.997616:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265516800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784185081.997644:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185081.997654:0:14125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185081.997717:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265516928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784185081.997755:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185081.997782:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb8c8c000 going to sleep for 11 seconds 00000100:00100000:0.0:1784185081.998298:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265516928 00000100:00100000:0.0:1784185081.998305:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265516928 00000100:00100000:0.0:1784185081.998424:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784185081.998434:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265516928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784185081.998453:0:14122:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784185081.998471:0:14122:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784185081.998474:0:14122:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1784185081.998559:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265516928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185081.998578:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784185081.999074:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265516928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784185081.999120:0:14125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784185081.999128:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185081.999138:0:14125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185082.634631:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784185082.891470:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784185083.662768:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185084.682518:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784185085.488713:0:14410:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784185085.718391:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784185086.161710:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784185086.161716:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784185086.161719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784185086.161722:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784185086.161725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784185086.161728:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784185086.161731:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784185086.161744:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b5fb74ab000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1784185086.161768:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbf50dc00 x1870853265517184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784185086.161814:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784185086.161827:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265517056:0@lo:400:kworker.0 00000100:00100000:3.0:1784185086.161895:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185086.161958:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265517056 00000100:00100000:3.0:1784185086.161965:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265517056 00000100:00100000:3.0:1784185086.162004:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784185086.162012:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:3314:x1870853265517056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185086.162060:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:3314:x1870853265517056:12345-0@lo:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185086.162067:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784185086.162115:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265517056:0@lo:400:kworker.0 00000100:00100000:2.0:1784185086.171486:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265517184:0@lo:38:kworker.0 00000100:00100000:2.0:1784185086.171588:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185086.175775:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265517184 00000100:00100000:3.0:1784185086.175796:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265517184 00000100:00100000:3.0:1784185086.175846:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784185086.175853:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1870853265517184:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784185086.175881:0:14130:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1784185086.175919:0:14130:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x63160f6fbe8b10ae 00000004:00100000:3.0:1784185086.175936:0:14130:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784185086.176062:0:14130:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ac000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784185086.176160:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1870853265517184:12345-0@lo:38:kworker.0 Request processed in 305us (4572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185086.176168:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784185086.176227:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b5fbf50dc00 x1870853265517184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784185096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784185086.176242:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784185086.176248:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784185086.176253:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784185086.176255:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784185086.176261:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1870853265517184:0@lo:38:kworker.0 00010000:00010000:0.0:1784185086.731508:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185087.754711:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784185088.567201:0:14561:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd696137b0 20000000:00000080:1.0:1784185088.567220:0:14561:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b5fbc1a0400 uarg=0000000000000000 20000000:01000000:1.0:1784185088.567249:0:14561:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784185088.567255:0:14561:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784185088.567259:0:14561:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784185088.568251:0:14562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1784185088.568639:0:14561:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784185088.574961:0:14561:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784185088.575080:0:14561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185088.575159:0:14561:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 11 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185088.575184:0:14561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185088.575227:0:14561:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 11 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185088.575242:0:14561:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 11 pid: 14122 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185088.575256:0:14561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14561:1870853265517312:0@lo:104: 00000100:00100000:0.0:1784185088.575319:0:14561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185088.575767:0:14561:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf300 going to sleep for 11 seconds 00000100:00100000:1.0:1784185088.575832:0:14111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265517312 00000100:00100000:1.0:1784185088.575840:0:14111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265517312 00000100:00100000:0.0:1784185088.575982:0:14111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784185088.575991:0:14111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14561:x1870853265517312:12345-0@lo:104: 00010000:00010000:0.0:1784185088.576004:0:14111:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185088.576068:0:14111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784185088.576074:0:14111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14561:x1870853265517312:12345-0@lo:104: Request processed in 84us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185088.576080:0:14111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1784185088.576134:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185088.576140:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576147:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9e00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:1.0:1784185088.576152:0:14117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576159:0:14117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784185088.576167:0:14117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185088.576181:0:14117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784185088.576214:0:14117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576220:0:14117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784185088.576239:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576246:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b106f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1076 expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576260:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185088.576262:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185088.576263:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185088.576366:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265517440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784185088.576398:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185088.576435:0:14113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265517440 00000100:00100000:1.0:1784185088.576439:0:14113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265517440 00010000:00010000:1.0:1784185088.576457:0:14113:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 12 pid: 14122 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185088.576496:0:14113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784185088.576503:0:14113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:3314:x1870853265517440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784185088.576512:0:14113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784185088.576518:0:14113:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 12 pid: 14122 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576528:0:14113:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 12 pid: 14122 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576552:0:14113:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576559:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576572:0:14113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576579:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576586:0:14113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576593:0:14113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576598:0:14113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185088.576603:0:14113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576610:0:14113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576618:0:14113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185088.576627:0:14113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784185088.576655:0:14113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:3314:x1870853265517440:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185088.576672:0:14113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784185088.576710:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265517440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784185088.576797:0:14561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5fc158d200/0x63160f6fbe8b1076 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b106f expref: 11 pid: 14122 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185088.576809:0:14561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14561:1870853265517312:0@lo:104: 00010000:00010000:3.0:1784185088.576822:0:14561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185088.576831:0:14561:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185088.576843:0:14561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185088.576848:0:14561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b10b5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185088.784437:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185089.802584:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185090.250472:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784185080/real 1784185080] req@ffff9b5faf054380 x1870853265514496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185090 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185090.250534:0:3312:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b5faf054380 x1870853265514496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185090 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185090.250545:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784185080/real 1784185080] req@ffff9b5faf055f80 x1870853265514368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185090 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185090.250579:0:3312:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b5faf055f80 x1870853265514368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185090 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784185090.250598:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784185090.250626:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784185090.250630:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265514496:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784185090.250636:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d97000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784185090.250640:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784185090.250643:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265514368:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784185090.250797:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784185090.250801:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784185090.250804:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d97000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784185090.250816:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:2.0:1784185090.250820:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784185090.250827:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b5fb7d97000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784185090.250848:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbfbcce00 x1870853265517696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784185090.250858:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784185090.250861:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784185090.250863:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784185090.250866:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 478 00000100:00080000:2.0:1784185090.250868:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784185090.250871:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b5fb7d95000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784185090.250881:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbfbcca80 x1870853265517824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784185090.250926:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265517952:0@lo:400:kworker.0 00000100:00100000:2.0:1784185090.250989:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185090.251044:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784185090.251050:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265517568:0@lo:400:kworker.0 00000100:00100000:2.0:1784185090.251079:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185090.251084:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265517952 00000100:00100000:1.0:1784185090.251092:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265517952 00000100:00100000:2.0:1784185090.251112:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265517568 00000100:00100000:2.0:1784185090.251115:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265517568 00000100:00100000:1.0:1784185090.251131:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784185090.251136:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784185090.251139:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265517952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185090.251141:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:3316:x1870853265517568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185090.251186:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:3316:x1870853265517568:12345-0@lo:400:kworker.0 Request processed in 44us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185090.251194:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784185090.251195:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265517952:12345-0@lo:400:kworker.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185090.251201:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784185090.251241:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265517568:0@lo:400:kworker.0 00010000:00080000:2.0:1784185090.251254:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b5fbfbcd880 x1870853265517952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185090.251263:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265517952:0@lo:400:kworker.0 00000100:00100000:0.0:1784185090.251493:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265517696:0@lo:8:kworker.0 00000400:00000100:0.0:1784185090.251522:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870853265517696 offset 0 length 520: 4 00000100:00100000:0.0:1784185090.251543:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265517824:0@lo:8:kworker.0 00000400:00000100:0.0:1784185090.251576:0:3312:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870853265517824 offset 0 length 520: 4 10000000:01000000:3.0:1784185090.251797:0:14125:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784185090.251801:0:14125:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbf5dc000 from 10 10000000:01000000:3.0:1784185090.251805:0:14125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784185090.251837:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185090.251847:0:14125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185090.251857:0:14125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185090.251874:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265518080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784185090.251904:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185090.251930:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fa000e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185090.251945:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518080 00000100:00100000:3.0:1784185090.251949:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518080 00000100:00100000:3.0:1784185090.251982:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784185090.251989:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+11:14125:x1870853265518080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784185090.251998:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185090.252062:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b10bc expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185090.252096:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185090.252107:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185090.252117:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f9896f200, rc 0) 00000100:00100000:3.0:1784185090.252158:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265518080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185090.252164:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784185090.252263:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265518080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784185090.252277:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185090.252286:0:14125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185090.252363:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265518208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185090.252391:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185090.252417:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e812f4300 going to sleep for 11 seconds 00000100:00100000:3.0:1784185090.252479:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518208 00000100:00100000:3.0:1784185090.252484:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518208 00000100:00100000:3.0:1784185090.252501:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784185090.252506:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265518208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784185090.253053:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265518208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 544us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185090.253061:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784185090.257065:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265518208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185090.257137:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265518336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784185090.257220:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185090.257272:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e812f4300 going to sleep for 11 seconds 00000100:00100000:0.0:1784185090.257372:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518336 00000100:00100000:0.0:1784185090.257380:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518336 00000100:00100000:0.0:1784185090.257434:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784185090.257442:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265518336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784185090.258003:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14125:x1870853265518336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 557us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185090.258012:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784185090.258163:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265518336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784185090.259918:0:14622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784185090.268622:0:14125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784185090.268672:0:14125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784185090.268684:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185090.268696:0:14125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185090.827512:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185091.851768:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784185092.107973:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784185092.874630:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784185093.523243:0:14761:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784185093.523247:0:14761:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1784185093.523798:0:14761:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b5fbf93f000 00000020:01000004:0.0:1784185093.523816:0:14761:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784185093.523827:0:14761:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784185093.523865:0:14761:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b5fbc0f4d40) 00000020:00000080:0.0:1784185093.523881:0:14761:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784185093.553646:0:14761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784185093.554029:0:14761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784185093.555049:0:14761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784185093.555608:0:14761:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784185093.555898:0:14761:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784185093.556635:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 327: rc = 0 00100000:10000000:2.0:1784185093.556722:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 327: rc = 0 00100000:10000000:2.0:1784185093.556791:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 327: rc = 0 00100000:10000000:3.0:1784185093.560476:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1784185093.560765:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1784185093.561005:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1784185093.561247:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1784185093.561530:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1784185093.561758:0:14761:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:3.0:1784185093.562274:0:14761:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784185093.562285:0:14761:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784185093.562297:0:14761:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63160f6fbe8b10d1 00000020:01000004:3.0:1784185093.562304:0:14761:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1784185093.562325:0:14761:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784185093.562328:0:14761:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784185093.562365:0:14761:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784185093.562370:0:14761:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784185093.562381:0:14761:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b5fb9333380) 00000020:00000080:3.0:1784185093.562391:0:14761:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1784185093.565793:0:14761:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784185093.565968:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1784185093.565975:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784185093.570474:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784185093.570541:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784185093.570827:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784185093.570831:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784185093.572018:0:14761:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185093.572592:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784185093.572599:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784185093.574155:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784185093.574168:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784185093.593777:0:14761:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185093.594003:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784185093.594010:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784185093.595923:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784185093.595935:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784185093.597459:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784185093.597473:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784185093.599495:0:14761:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185093.599695:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784185093.599700:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784185093.601744:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784185093.601756:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1784185093.648913:0:14761:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784185093.649088:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1784185093.649094:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1784185093.652369:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1784185093.652384:0:14761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784185093.653413:0:14761:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784185093.653440:0:14761:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784185093.653446:0:14761:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784185093.661707:0:14761:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784185093.661750:0:14761:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1784185093.661753:0:14761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784185093.661754:0:14761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784185093.661755:0:14761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784185093.661756:0:14761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784185093.661757:0:14761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784185093.661758:0:14761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784185093.661759:0:14761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784185093.661760:0:14761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784185093.661761:0:14761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784185093.661764:0:14761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1784185093.661765:0:14761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784185093.661766:0:14761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784185093.661767:0:14761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784185093.661767:0:14761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784185093.661768:0:14761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784185093.661769:0:14761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784185093.661769:0:14761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784185093.661770:0:14761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784185093.661771:0:14761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784185093.661793:0:14761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784185093.661810:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784185093.661867:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185093.661908:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518464 00000100:00100000:2.0:1784185093.661916:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518464 00000100:00100000:1.0:1784185093.661922:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784185093.661962:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784185093.661971:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14761:x1870853265518464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784185093.662010:0:14122:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784185093.662014:0:14122:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1784185093.662018:0:14122:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784185093.666950:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14761:x1870853265518464:12345-0@lo:253:mount.lustre.0 Request processed in 4971us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185093.666965:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784185093.667313:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784185093.667365:0:14761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784185093.667370:0:14761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784185093.667371:0:14761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784185093.667372:0:14761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784185093.667374:0:14761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784185093.667375:0:14761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784185093.667376:0:14761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784185093.667377:0:14761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784185093.667379:0:14761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784185093.667380:0:14761:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784185093.667412:0:14761:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b5fbf93f000 from lustre-OST0000 10000000:01000000:0.0:1784185093.667459:0:14761:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784185093.667462:0:14761:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784185093.667468:0:14761:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b5fb722b380 local copy 00010000:00010000:0.0:1784185093.667479:0:14761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185093.667697:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf055f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784185093.667735:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185093.667827:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb51aba80 going to sleep for 11 seconds 00000100:00100000:3.0:1784185093.667973:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518592 00000100:00100000:3.0:1784185093.667980:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518592 00000100:00100000:3.0:1784185093.668120:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784185093.668131:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14761:x1870853265518592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185093.668325:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14761:x1870853265518592:12345-0@lo:501:mount.lustre.0 Request processed in 195us (588us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784185093.668358:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784185093.668453:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf055f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518592:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784185093.668468:0:14761:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784185093.668630:0:14761:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784185093.668637:0:14761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.668647:0:14761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185093.668668:0:14761:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b5fbf93f000 10000000:01000000:1.0:1784185093.668680:0:14761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784185093.668685:0:14761:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b5fb722b380 10000000:01000000:1.0:1784185093.668687:0:14761:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784185093.668690:0:14761:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b5fb722b380 from 1 10000000:01000000:1.0:1784185093.668693:0:14761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784185093.668718:0:14761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b10df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.668727:0:14761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b10df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.668736:0:14761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b10df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185093.668751:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784185093.668781:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185093.669031:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.669265:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518720 00000100:00100000:0.0:1784185093.669281:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518720 00000100:00100000:0.0:1784185093.669309:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784185093.669316:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+12:14761:x1870853265518720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784185093.669327:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185093.669424:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8b10e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b10df expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.669448:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8b10e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b10df expref: 13 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.669457:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631cc00/0x63160f6fbe8b10e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b10df expref: 13 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.669465:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631cc00, rc 0) 00000100:00100000:0.0:1784185093.669544:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+13:14761:x1870853265518720:12345-0@lo:101:mount.lustre.0 Request processed in 227us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.669554:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784185093.669717:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784185093.669732:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b10df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10e6 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.669741:0:14761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b10df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b10e6 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185093.669759:0:14761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784185093.669816:0:14761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b10df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10e6 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.669824:0:14761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8c00/0x63160f6fbe8b10df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10e6 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185093.669842:0:14761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784185093.669846:0:14761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784185093.669851:0:14761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784185093.669853:0:14761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784185093.669872:0:14761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8600/0x63160f6fbe8b10ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.669878:0:14761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8600/0x63160f6fbe8b10ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.669885:0:14761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8600/0x63160f6fbe8b10ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185093.669900:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784185093.669928:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185093.669958:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.670009:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518848 00000100:00100000:0.0:1784185093.670023:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518848 00000100:00100000:0.0:1784185093.670056:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784185093.670063:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+13:14761:x1870853265518848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784185093.670071:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185093.670080:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631dc00/0x63160f6fbe8b10f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b10ed expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.670094:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631dc00/0x63160f6fbe8b10f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b10ed expref: 14 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.670101:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631dc00/0x63160f6fbe8b10f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b10ed expref: 14 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.670113:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631dc00, rc 0) 00000100:00100000:0.0:1784185093.670152:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265518848:12345-0@lo:101:mount.lustre.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.670158:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784185093.670430:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185093.670452:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8600/0x63160f6fbe8b10ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10f4 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.670460:0:14761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8600/0x63160f6fbe8b10ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b10f4 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784185093.671194:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784185093.672993:0:14761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784185093.673656:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784185093.673701:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784185093.673734:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784185093.673777:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784185093.673806:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784185093.673831:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784185093.673910:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784185093.673918:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1784185093.674005:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185093.674318:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185093.674406:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf000 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.674472:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265518976 00000100:00100000:0.0:1784185093.674479:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265518976 00000100:00100000:0.0:1784185093.674531:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784185093.674540:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265518976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784185093.674884:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265518976:12345-0@lo:501:mount.lustre.0 Request processed in 344us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.674892:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784185093.675178:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265518976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185093.675289:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784185093.675364:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185093.675388:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf000 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.675500:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265519104 00000100:00100000:0.0:1784185093.675505:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265519104 00000100:00100000:0.0:1784185093.675543:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784185093.675550:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265519104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185093.675926:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265519104:12345-0@lo:503:mount.lustre.0 Request processed in 375us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.675932:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784185093.676315:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784185093.677780:0:14761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784185093.677872:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784185093.677944:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185093.678033:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f866f7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784185093.678144:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265519232 00000100:00100000:1.0:1784185093.678151:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265519232 00000100:00100000:1.0:1784185093.678448:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784185093.678459:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265519232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784185093.678683:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265519232:12345-0@lo:502:mount.lustre.0 Request processed in 226us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185093.678691:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784185093.678790:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185093.679056:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784185093.679110:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784185093.679145:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784185093.679192:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784185093.679250:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784185093.679296:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784185093.679548:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784185093.679589:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784185093.679638:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1784185093.679688:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1784185093.679726:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1784185093.679772:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1784185093.679810:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784185093.679861:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185093.680261:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f938b1540 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.680505:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265519360 00000100:00100000:0.0:1784185093.680512:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265519360 00000100:00100000:0.0:1784185093.680552:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784185093.680560:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265519360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784185093.680758:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265519360:12345-0@lo:502:mount.lustre.0 Request processed in 198us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.680766:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784185093.680874:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185093.680956:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784185093.680968:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1784185093.682104:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784185093.682113:0:14775:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784185093.682120:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185093.682122:0:14775:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784185093.682128:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784185093.682143:0:14775:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b5fb9334d40) 00000020:00000080:3.0:1784185093.682351:0:14775:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784185093.682360:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784185093.682435:0:14775:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fbf93f000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784185093.682444:0:14775:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784185093.682465:0:14775:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x63160f6fbe8b1102 00010000:00010000:3.0:1784185093.688087:0:14775:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1784185093.689173:0:14775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1784185093.691683:0:14775:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1784185093.702154:0:14775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784185093.702173:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185093.702180:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185093.702182:0:14775:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784185093.702185:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784185093.702188:0:14775:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1784185093.702189:0:14775:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784185093.702191:0:14775:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784185093.702192:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784185093.702194:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185093.702196:0:14775:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784185093.702198:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185093.702201:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185093.702202:0:14775:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784185093.702204:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784185093.702206:0:14775:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784185093.702208:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185093.703876:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185093.703882:0:14775:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784185093.703891:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185093.703894:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185093.703896:0:14775:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784185093.703899:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784185093.703974:0:14775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185093.703978:0:14775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185093.703979:0:14775:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784185093.703982:0:14775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1784185093.705639:0:14761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1784185093.705683:0:14761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784185093.705739:0:14761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8600/0x63160f6fbe8b10ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10f4 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.705766:0:14761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8600/0x63160f6fbe8b10ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b10f4 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185093.705774:0:14761:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbf93f000 from 1 10000000:01000000:1.0:1784185093.705777:0:14761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784185093.705816:0:14761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.705824:0:14761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.705833:0:14761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185093.705859:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784185093.705928:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185093.705965:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1600 going to sleep for 11 seconds 00000100:00100000:1.0:1784185093.706918:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265519488 00000100:00100000:1.0:1784185093.706929:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265519488 00000100:00100000:1.0:1784185093.706973:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784185093.706982:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+14:14761:x1870853265519488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784185093.706996:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185093.707010:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b1109 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.707034:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 15 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.707056:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 15 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.707065:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9400, rc 0) 00000100:00100000:1.0:1784185093.707115:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265519488:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185093.707122:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784185093.707175:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784185093.707190:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.707199:0:14761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784185093.707757:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784185093.708101:0:14761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784185093.708368:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784185093.708427:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784185093.708493:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784185093.708501:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784185093.708558:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784185093.708601:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185093.708634:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265519616 00000100:00100000:2.0:1784185093.708640:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265519616 00000100:00100000:1.0:1784185093.708651:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1600 going to sleep for 11 seconds 00000100:00100000:2.0:1784185093.708677:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784185093.708684:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265519616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185093.708907:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265519616:12345-0@lo:501:mount.lustre.0 Request processed in 222us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185093.708915:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784185093.709744:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784185093.709782:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784185093.709828:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185093.709867:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1600 going to sleep for 11 seconds 00000100:00100000:3.0:1784185093.709932:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265519744 00000100:00100000:3.0:1784185093.709938:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265519744 00000100:00100000:3.0:1784185093.710152:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784185093.710161:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265519744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784185093.710923:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265519744:12345-0@lo:503:mount.lustre.0 Request processed in 761us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185093.710932:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784185093.711068:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784185093.711882:0:14761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784185093.711954:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784185093.712005:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185093.712044:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1600 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.712238:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265519872 00000100:00100000:0.0:1784185093.712245:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265519872 00000100:00100000:0.0:1784185093.712289:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784185093.712307:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265519872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784185093.712511:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265519872:12345-0@lo:502:mount.lustre.0 Request processed in 205us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.712526:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784185093.713006:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265519872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784185093.713275:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784185093.713505:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784185093.713565:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784185093.713600:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784185093.713629:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784185093.713670:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784185093.713705:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784185093.713739:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1784185093.713773:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784185093.713823:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185093.713985:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1600 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.714136:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520000 00000100:00100000:0.0:1784185093.714142:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520000 00000100:00100000:0.0:1784185093.714224:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784185093.714232:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265520000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784185093.714662:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265520000:12345-0@lo:502:mount.lustre.0 Request processed in 430us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.714669:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784185093.715081:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185093.715203:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784185093.715232:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1784185093.717941:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784185093.717954:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185093.717957:0:14779:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784185093.717964:0:14779:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fbf93f000 00000020:00000080:2.0:1784185093.717967:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784185093.717974:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784185093.717977:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185093.717979:0:14779:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784185093.717982:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784185093.717984:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185093.717985:0:14779:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784185093.717988:0:14779:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fbf93f000 00000020:00000080:2.0:1784185093.717991:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784185093.718086:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784185093.718090:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185093.718092:0:14779:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784185093.718094:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784185093.718097:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185093.718098:0:14779:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784185093.718102:0:14779:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b5fbf93f000 00000020:00000080:2.0:1784185093.718104:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784185093.719644:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784185093.719736:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784185093.719738:0:14779:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784185093.719743:0:14779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1784185093.720005:0:14761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1784185093.720033:0:14761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784185093.720059:0:14761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.720072:0:14761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185093.720115:0:14761:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784185093.720118:0:14761:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b5fbf93f000 10000000:01000000:0.0:1784185093.720122:0:14761:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b5fbf93f000 10000000:01000000:0.0:1784185093.720126:0:14761:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784185093.720131:0:14761:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fbf93f000 from 1 10000000:01000000:0.0:1784185093.720134:0:14761:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784185093.720173:0:14761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d200/0x63160f6fbe8b1117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.720182:0:14761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d200/0x63160f6fbe8b1117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.720192:0:14761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d200/0x63160f6fbe8b1117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185093.721449:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784185093.721521:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185093.721554:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f91fa8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784185093.721731:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520128 00000100:00100000:1.0:1784185093.721739:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520128 00000100:00100000:1.0:1784185093.721794:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784185093.721802:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265520128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784185093.721818:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185093.721835:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd9a00/0x63160f6fbe8b111e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b1117 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.721874:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd9a00/0x63160f6fbe8b111e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b1117 expref: 16 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.721895:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd9a00/0x63160f6fbe8b111e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1117 expref: 16 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185093.721904:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9a00, rc 0) 00000100:00100000:1.0:1784185093.721954:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520128:12345-0@lo:101:mount.lustre.0 Request processed in 151us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185093.721960:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784185093.722063:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185093.722079:0:14761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d200/0x63160f6fbe8b1117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b111e expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.722099:0:14761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d200/0x63160f6fbe8b1117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b111e expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784185093.722826:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1784185093.723117:0:14761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784185093.725572:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784185093.725653:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784185093.725689:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784185093.725733:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784185093.725772:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784185093.725837:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784185093.725874:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784185093.725906:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784185093.725953:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784185093.725989:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784185093.726022:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784185093.726068:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784185093.726104:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784185093.726139:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784185093.726184:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784185093.728624:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784185093.728714:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784185093.728790:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784185093.728827:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784185093.728862:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784185093.728911:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784185093.728969:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784185093.729004:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784185093.729052:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784185093.729089:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1784185093.729124:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1784185093.729181:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1784185093.733086:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1784185093.734424:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1784185093.734443:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1784185093.734545:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185093.734613:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185093.734676:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185093.735323:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520256 00000100:00100000:3.0:1784185093.735350:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520256 00000100:00100000:3.0:1784185093.735408:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784185093.735418:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185093.735669:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520256:12345-0@lo:501:mount.lustre.0 Request processed in 252us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185093.735677:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784185093.736430:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185093.736480:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784185093.736528:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185093.736567:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7ddf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.739469:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520384 00000100:00100000:0.0:1784185093.739484:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520384 00000100:00100000:0.0:1784185093.739547:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784185093.739557:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185093.739800:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520384:12345-0@lo:503:mount.lustre.0 Request processed in 244us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.739808:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784185093.740422:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784185093.741076:0:14761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784185093.741155:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784185093.741292:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185093.741361:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8821e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.743354:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520512 00000100:00100000:0.0:1784185093.743367:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520512 00000100:00100000:0.0:1784185093.743420:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784185093.743434:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784185093.743725:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520512:12345-0@lo:502:mount.lustre.0 Request processed in 296us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.743734:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784185093.743849:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185093.744109:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784185093.744163:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784185093.744201:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784185093.744503:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784185093.744815:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784185093.744877:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784185093.744921:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784185093.744970:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784185093.745040:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784185093.745079:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784185093.745115:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784185093.745164:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784185093.745203:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784185093.746424:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784185093.746495:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784185093.746533:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784185093.746568:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784185093.746618:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784185093.746657:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784185093.746692:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784185093.746741:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784185093.746778:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784185093.746814:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784185093.746865:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784185093.746924:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1784185093.746959:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1784185093.747003:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1784185093.747039:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1784185093.747072:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1784185093.747116:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1784185093.747148:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1784185093.747179:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1784185093.748684:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1784185093.748805:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1784185093.748845:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1784185093.748895:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1784185093.748934:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1784185093.748969:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1784185093.749015:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1784185093.749051:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1784185093.749113:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784185093.749193:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185093.751378:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8821e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185093.751425:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520640 00000100:00100000:3.0:1784185093.751433:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520640 00000100:00100000:3.0:1784185093.751487:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784185093.751497:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784185093.751758:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265520640:12345-0@lo:502:mount.lustre.0 Request processed in 262us (2566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185093.751766:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784185093.751836:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265520640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185093.751940:0:14761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1784185093.751953:0:14761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1784185093.757705:0:14784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784185093.757723:0:14784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b5f844fcd40) 00000020:00000080:2.0:1784185093.757746:0:14784:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1784185093.757911:0:14784:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fbf93f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784185093.757916:0:14784:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5fbf93f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784185093.757919:0:14784:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fbf93f000 3 00010000:00080000:2.0:1784185093.757948:0:14784:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5fb74c9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1784185093.759617:0:14784:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1784185093.759713:0:14784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784185093.759747:0:14784:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784185093.759758:0:14784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x63160f6fbe8b112c 00000100:00080000:2.0:1784185093.759769:0:14784:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784185093.759774:0:14784:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b5fb74c9800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784185093.759808:0:14784:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbfbcc700 x1870853265520768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784185093.759842:0:14784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784185093.759870:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1870853265520768:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784185093.760383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784185093.760450:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784185093.760455:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784185093.760458:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784185093.760461:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784185093.760513:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520768 00000100:00100000:0.0:1784185093.760519:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520768 00000100:00100000:0.0:1784185093.760552:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784185093.760559:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1870853265520768:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784185093.760582:0:14128:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:0.0:1784185093.760615:0:14128:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x63160f6fbe8b1133 00000004:00100000:0.0:1784185093.760630:0:14128:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784185093.760668:0:14128:0:(import.c:65:import_set_state_nolock()) ffff9b5fb6fc6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784185093.760717:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1870853265520768:12345-0@lo:38:llog_process_th.0 Request processed in 157us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.760725:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784185093.760759:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265520896:0@lo:400:kworker.0 00000040:00080000:3.0:1784185093.760770:0:14784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1784185093.760785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784185093.760817:0:14761:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:0.0:1784185093.760821:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265520896 00000100:00100000:0.0:1784185093.760824:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265520896 10000000:01000000:3.0:1784185093.760844:0:14761:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1784185093.760847:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784185093.760852:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265520896:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1784185093.760863:0:14761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d200/0x63160f6fbe8b1117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b111e expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185093.760874:0:14761:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631d200/0x63160f6fbe8b1117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b111e expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185093.760884:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265520896:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.760906:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1784185093.760917:0:14761:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784185093.760919:0:14761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784185093.760921:0:14761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784185093.760922:0:14761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784185093.760923:0:14761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784185093.760924:0:14761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784185093.760926:0:14761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784185093.760928:0:14761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784185093.760933:0:14761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784185093.760937:0:14761:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1784185093.760939:0:14761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784185093.760940:0:14761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00010000:00080000:0.0:1784185093.760940:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b5faf057100 x1870853265520896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:01000004:3.0:1784185093.760941:0:14761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784185093.760942:0:14761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784185093.760944:0:14761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784185093.760945:0:14761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784185093.760945:0:14761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784185093.760947:0:14761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784185093.760948:0:14761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784185093.760954:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265520896:0@lo:400:kworker.0 10000000:01000000:3.0:1784185093.760960:0:14761:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784185093.760971:0:14761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265521024:0@lo:253:mount.lustre.0 00010000:00080000:0.0:1784185093.760978:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b5fbfbcc700 x1870853265520768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784185103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185093.760996:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1784185093.761003:0:14761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784185093.761003:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1784185093.761009:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1784185093.761022:0:14761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8821e0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1784185093.761286:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784185093.761288:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784185093.761293:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1870853265520768:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784185093.761311:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521024 00000100:00100000:0.0:1784185093.761314:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521024 00000100:00100000:0.0:1784185093.761354:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784185093.761361:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14761:x1870853265521024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784185093.761390:0:14122:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784185093.761415:0:14122:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784185093.789607:0:14122:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784185093.789654:0:14122:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784185093.789754:0:14144:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784185093.789759:0:14144:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784185093.789778:0:14144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185093.789792:0:14144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 16 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185093.789799:0:14144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185093.789831:0:14144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 16 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185093.789842:0:14144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 16 pid: 14121 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185093.789853:0:14144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14144:1870853265521152:0@lo:104: 00000100:00100000:3.0:1784185093.789913:0:14144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185093.789968:0:14144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f8821e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784185093.790029:0:14112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521152 00000100:00100000:0.0:1784185093.790036:0:14112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521152 00000100:00100000:0.0:1784185093.790086:0:14112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784185093.790095:0:14112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14144:x1870853265521152:12345-0@lo:104: 00010000:00010000:0.0:1784185093.790108:0:14112:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.790174:0:14112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784185093.790181:0:14112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14144:x1870853265521152:12345-0@lo:104: Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185093.790187:0:14112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784185093.790207:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1784185093.790311:0:14144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14144:1870853265521152:0@lo:104: 00010000:00010000:1.0:1784185093.790473:0:14144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.790667:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.790686:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784185093.790690:0:14117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.790699:0:14117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784185093.790706:0:14117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185093.790713:0:14117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784185093.790770:0:14117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.790775:0:14117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784185093.790790:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.790795:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896f600/0x63160f6fbe8b10a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b10a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.790804:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185093.790805:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185093.790806:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185093.791186:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265521280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784185093.791299:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185093.791472:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521280 00000100:00100000:2.0:1784185093.791479:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521280 00010000:00010000:2.0:1784185093.791502:0:14115:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 17 pid: 14121 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185093.791534:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784185093.791543:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:3314:x1870853265521280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784185093.791553:0:14115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185093.791558:0:14115:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 17 pid: 14121 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791568:0:14115:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 17 pid: 14121 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791581:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b10a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b10a0 expref: 17 pid: 14121 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791594:0:14115:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791602:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784185093.791614:0:14115:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001855928s 00010000:00010000:2.0:1784185093.791617:0:14115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791622:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791627:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791638:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791641:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ea00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185093.791645:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791649:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791669:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185093.791678:0:14115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185093.791725:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3314:x1870853265521280:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185093.791732:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784185093.791826:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265521280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784185093.791845:0:14144:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.791858:0:14144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185093.791865:0:14144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896ea00/0x63160f6fbe8b113a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185093.799739:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14761:x1870853265521024:12345-0@lo:253:mount.lustre.0 Request processed in 38369us (38725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185093.799755:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784185093.799865:0:14761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14761:1870853265521024:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784185093.799882:0:14761:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784185093.799886:0:14761:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784185093.799888:0:14761:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784185093.799889:0:14761:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784185093.799890:0:14761:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784185093.799892:0:14761:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784185093.799893:0:14761:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784185093.799894:0:14761:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784185093.799896:0:14761:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784185093.799897:0:14761:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784185093.799911:0:14761:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784185093.804881:0:14761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784185093.805068:0:14761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784185093.805389:0:14761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784185093.805560:0:14761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784185093.805708:0:14761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784185093.805926:0:14761:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784185093.806931:0:14761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784185093.858506:0:14761:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784185093.858516:0:14761:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784185093.858545:0:14761:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784185093.858597:0:14761:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784185093.858629:0:14761:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784185093.858653:0:14761:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784185093.908356:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185094.927908:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784185095.508859:0:14125:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784185095.508867:0:14125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5fbf5dc000 from 7 10000000:01000000:3.0:1784185095.508873:0:14125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784185095.509569:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185095.509584:0:14125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185095.509594:0:14125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185095.509637:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265521408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784185095.509705:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185095.509759:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f84aae180 going to sleep for 11 seconds 00000100:00100000:0.0:1784185095.512326:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521408 00000100:00100000:0.0:1784185095.512378:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521408 00000100:00100000:0.0:1784185095.512432:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784185095.512442:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+15:14125:x1870853265521408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784185095.512460:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185095.512480:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b1141 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185095.512507:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 16 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185095.512518:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 16 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185095.512526:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784185095.512603:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14125:x1870853265521408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185095.512619:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784185095.515124:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265521408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784185095.515155:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185095.515168:0:14125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185095.515244:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265521536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784185095.515307:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185095.515389:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb7201480 going to sleep for 11 seconds 00000100:00100000:2.0:1784185095.515748:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521536 00000100:00100000:2.0:1784185095.515756:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521536 00000100:00100000:2.0:1784185095.515812:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784185095.515822:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14125:x1870853265521536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784185095.515843:0:14122:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784185095.515862:0:14122:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784185095.515866:0:14122:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1784185095.515995:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14125:x1870853265521536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 174us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185095.516004:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784185095.516201:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265521536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784185095.516269:0:14125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784185095.516278:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185095.516287:0:14125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185095.948201:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185096.973933:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185097.994832:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784185098.954593:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784185098.954600:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784185098.954603:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784185098.954606:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784185098.954669:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265521792:0@lo:400:kworker.0 00000100:00100000:2.0:1784185098.954738:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185098.954815:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784185098.954822:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265521664:0@lo:400:kworker.0 00000100:00100000:2.0:1784185098.954849:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185098.954885:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265521920:0@lo:400:kworker.0 00000100:00100000:2.0:1784185098.954913:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185098.954955:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521792 00000100:00100000:2.0:1784185098.954963:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521792 00000100:00100000:2.0:1784185098.955006:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521920 00000100:00100000:2.0:1784185098.955009:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521920 00000100:00100000:2.0:1784185098.955034:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784185098.955042:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185098.955096:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265521792:12345-0@lo:400:kworker.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185098.955103:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784185098.955119:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784185098.955124:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265521920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185098.955154:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1870853265521920:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185098.955160:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784185098.955191:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265521664 00000100:00100000:2.0:1784185098.955194:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265521664 00000100:00100000:2.0:1784185098.955214:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784185098.955220:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3316:x1870853265521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185098.955250:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3316:x1870853265521664:12345-0@lo:400:kworker.0 Request processed in 30us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185098.955256:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1784185098.955307:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbfbcd180 x1870853265521920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185098.955329:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1870853265521920:0@lo:400:kworker.0 00000100:00100000:2.0:1784185098.955384:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265521664:0@lo:400:kworker.0 00010000:00080000:2.0:1784185098.955394:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbfbcd500 x1870853265521792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185098.955402:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265521792:0@lo:400:kworker.0 00000100:00080000:0.0:1784185098.955514:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784185099.022035:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185100.042520:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784185100.407052:0:15125:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784185101.070721:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185102.090535:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784185102.347015:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784185103.115591:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784185104.075747:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784185104.075754:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784185104.075757:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784185104.075759:0:1384:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784185104.075805:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265522048:0@lo:400:kworker.0 00000100:00100000:1.0:1784185104.075874:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185104.075947:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265522304:0@lo:400:kworker.0 00000100:00100000:1.0:1784185104.075980:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185104.076001:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784185104.076006:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265522176:0@lo:400:kworker.0 00000100:00100000:1.0:1784185104.076030:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185104.077218:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522304 00000100:00100000:0.0:1784185104.077239:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522304 00000100:00100000:0.0:1784185104.077291:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522176 00000100:00100000:0.0:1784185104.077295:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522176 00000100:00100000:0.0:1784185104.077311:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185104.077319:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185104.077457:0:14128:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784185104.077466:0:14128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1784185104.078550:0:14130:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00080000:3.0:1784185104.078773:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185104.078788:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522048 00000100:00100000:3.0:1784185104.078794:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522048 00000100:00100000:3.0:1784185104.078826:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784185104.078834:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3314:x1870853265522048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185104.078906:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3314:x1870853265522048:12345-0@lo:400:kworker.0 Request processed in 72us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185104.078914:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784185104.079162:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784185104.079171:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265522176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185104.079210:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1870853265522176:12345-0@lo:400:kworker.0 Request processed in 41us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185104.079240:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784185104.079278:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265522048:0@lo:400:kworker.0 00010000:00080000:1.0:1784185104.079310:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fc1637100 x1870853265522176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185104.079322:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1870853265522176:0@lo:400:kworker.0 00000100:00100000:0.0:1784185104.079709:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265522304:12345-0@lo:400:kworker.0 Request processed in 2389us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185104.079718:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784185104.080657:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fc1635c00 x1870853265522304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185104.080671:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265522304:0@lo:400:kworker.0 00010000:00010000:3.0:1784185104.141269:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185105.035432:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784185090/real 1784185090] req@ffff9b5fbfbcce00 x1870853265517696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185105.035463:0:3312:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b5fbfbcce00 x1870853265517696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185105.035549:0:3312:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784185090/real 1784185090] req@ffff9b5fbfbcca80 x1870853265517824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784185105.035563:0:3312:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b5fbfbcca80 x1870853265517824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784185105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784185105.035581:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d97000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784185105.035638:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784185105.035643:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265517696:0@lo:8:kworker.0 00000100:00080000:1.0:1784185105.035650:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784185105.036797:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784185105.036803:0:1384:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784185105.036806:0:1384:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d97000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784185105.036812:0:1384:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1784185105.036817:0:1384:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784185105.036831:0:1384:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b5fb7d97000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1784185105.036852:0:1384:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbf50d500 x1870853265522560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784185105.036870:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784185105.036873:0:1384:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784185105.036875:0:1384:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784185105.036878:0:1384:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1784185105.036881:0:1384:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784185105.036884:0:1384:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b5fb7d95000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1784185105.036894:0:1384:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbf50d880 x1870853265522688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784185105.036935:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784185105.036950:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265522944:0@lo:400:kworker.0 00000100:00100000:3.0:1784185105.037020:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185105.037078:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522944 00000100:00100000:3.0:1784185105.037084:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522944 00000100:00100000:3.0:1784185105.037131:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784185105.037139:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265522944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185105.037276:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3313:1870853265522432:0@lo:400:kworker.0 00000100:00100000:2.0:1784185105.037312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185105.037370:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784185105.037376:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265522816:0@lo:400:kworker.0 00000100:00100000:2.0:1784185105.037398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185105.037422:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522432 00000100:00100000:2.0:1784185105.037426:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522432 00000100:00100000:2.0:1784185105.037454:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784185105.037459:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3313:x1870853265522432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185105.037523:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3313:x1870853265522432:12345-0@lo:400:kworker.0 Request processed in 62us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185105.037529:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784185105.037560:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522816 00000100:00100000:2.0:1784185105.037564:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522816 00000100:00100000:2.0:1784185105.037587:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784185105.037593:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265522816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185105.037625:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265522816:12345-0@lo:400:kworker.0 Request processed in 32us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185105.037631:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784185105.037665:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbf50d180 x1870853265522816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185105.037678:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265522816:0@lo:400:kworker.0 00000100:00100000:2.0:1784185105.037688:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3313:1870853265522432:0@lo:400:kworker.0 00000100:00100000:3.0:1784185105.037909:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1870853265522944:12345-0@lo:400:kworker.0 Request processed in 770us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185105.037917:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784185105.037990:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbf50c380 x1870853265522944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185105.038000:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1870853265522944:0@lo:400:kworker.0 00000100:00080000:1.0:1784185105.038113:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784185105.038119:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265517824:0@lo:8:kworker.0 00000100:00100000:1.0:1784185105.038149:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265522560:0@lo:8:kworker.0 00000100:00100000:1.0:1784185105.038318:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185105.038410:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265522688:0@lo:8:kworker.0 00000100:00100000:1.0:1784185105.038434:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185105.051233:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522560 00000100:00100000:2.0:1784185105.051247:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522560 00000100:00100000:2.0:1784185105.051298:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265522688 00000100:00100000:2.0:1784185105.051302:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265522688 00000100:00100000:2.0:1784185105.051321:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784185105.051347:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1870853265522560:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784185105.051381:0:14763:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:2.0:1784185105.051411:0:14763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8b114f 00002000:00100000:2.0:1784185105.051438:0:14763:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b5fb6fd5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784185105.051443:0:14763:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784185105.051446:0:14763:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784185105.052047:0:14763:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784185105.052075:0:14763:0:(import.c:65:import_set_state_nolock()) ffff9b5fb6fd4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784185105.052195:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1870853265522560:12345-0@lo:8:kworker.0 Request processed in 866us (13877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185105.052203:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784185105.052233:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784185105.052238:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1870853265522688:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784185105.052250:0:14763:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784185105.052277:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1870853265522688:12345-0@lo:8:kworker.0 Request processed in 38us (13841us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784185105.052282:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784185105.052600:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbf50d500 x1870853265522560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784185125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185105.052611:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784185105.052618:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784185105.052626:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784185105.052630:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784185105.052633:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d97000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784185105.052649:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784185105.052654:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265522560:0@lo:8:kworker.0 00000100:00080000:0.0:1784185105.052667:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784185105.052671:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784185105.052674:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265522688:0@lo:8:kworker.0 00000004:00080000:2.0:1784185105.052782:0:14151:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1784185105.052803:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14151:1870853265523200:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784185105.054401:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265523072:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1784185105.055793:0:14150:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784185105.058103:0:14150:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 503223768630ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784185105.059530:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185105.060621:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523072 00000100:00100000:3.0:1784185105.060633:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523072 00000100:00100000:3.0:1784185105.060690:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784185105.060701:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265523072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784185105.060738:0:14766:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784185105.060809:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1870853265523072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185105.060817:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1784185105.060852:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784185105.061137:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbfbcdf80 x1870853265523072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784185121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185105.061159:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265523072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784185105.066271:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185105.066374:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523200 00000100:00100000:2.0:1784185105.066384:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523200 00000100:00100000:2.0:1784185105.066432:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784185105.066441:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14151:x1870853265523200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784185105.068922:0:14765:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1784185105.068934:0:14765:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1784185105.068939:0:14765:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1784185105.076517:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f84aae840 going to sleep for 11 seconds 00002000:00010000:2.0:1784185105.097914:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.097927:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.097956:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.097962:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.097968:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.097986:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.097996:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.098004:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.098028:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.098043:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.098048:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.098056:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.098060:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.098067:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.098094:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.098102:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b1156 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.098119:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.098121:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.098122:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.101999:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.102012:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102029:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.102033:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.102040:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102053:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102064:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102071:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102151:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784185105.102615:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.102621:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102631:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.102634:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.102639:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102648:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102656:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.102663:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110601:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784185105.110617:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110631:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.110636:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110648:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110671:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110678:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b115d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110702:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185105.110706:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110713:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158dc00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.110723:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110732:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110742:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.110749:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.110750:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.110752:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.116231:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784185105.116246:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1164 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.116298:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.120381:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.120405:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.120423:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.120428:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.120434:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.120451:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.120462:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.121581:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.121617:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.121630:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.121636:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.121644:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.121649:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.121659:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.121687:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.121694:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d56208/0x63160f6fbe8b116b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.121711:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.121713:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.121715:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.123036:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.123046:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123060:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.123065:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.123071:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123083:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123093:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123101:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123181:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784185105.123846:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.123854:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123865:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.123869:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.123875:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123884:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123894:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.123902:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130133:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784185105.130148:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130162:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158ca00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.130167:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130188:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130220:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130229:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bd2222a/0x63160f6fbe8b1172 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130263:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185105.130268:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130274:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.130277:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130285:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130295:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.130301:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.130303:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.130304:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.132067:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784185105.132082:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f00fec/0x63160f6fbe8b1179 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.132274:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.133735:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.133745:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133767:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.133772:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.133778:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133793:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133803:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133810:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133830:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.133841:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.133846:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133855:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158dc00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.133860:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133869:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133897:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133905:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e924aceb/0x63160f6fbe8b1180 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.133921:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.133924:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.133926:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.134386:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.134393:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.134403:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.134406:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.134411:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.134419:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.134427:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.134434:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.134460:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.135019:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.135026:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.135034:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158de00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.135038:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.135045:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.135057:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.135066:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbd378e3/0x63160f6fbe8b1187 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.135081:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.135083:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.135084:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.138144:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.138157:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.138787:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.138803:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.138810:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.138880:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.138892:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.138899:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.138921:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784185105.139619:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185105.139628:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.139643:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.139647:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.139667:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.139684:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.139692:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb7a4426/0x63160f6fbe8b118e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.139711:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.139713:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.139715:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.141777:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.141791:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.141809:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.141814:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.141821:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.141842:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.141853:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.141868:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.141894:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784185105.142400:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.142407:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142417:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.142420:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.142425:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142434:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142443:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142450:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142654:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784185105.142670:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185105.142680:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142694:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.142698:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142707:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142723:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142730:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006deb5b53/0x63160f6fbe8b1195 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142750:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.142753:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142760:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158da00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.142763:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142770:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142780:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142793:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59e6a3c/0x63160f6fbe8b119c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.142807:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.142808:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.142810:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.143025:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.145455:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.145616:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145634:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.145638:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.145644:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145658:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145667:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145675:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145694:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.145709:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.145721:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145729:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.145734:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145744:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145761:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145768:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024a4fd5f/0x63160f6fbe8b11a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.145783:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.145785:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.145787:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.146259:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.146265:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.146275:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.146278:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.146282:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.146302:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.146310:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.146317:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.146355:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784185105.147026:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.147033:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147044:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.147047:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.147052:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147062:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147071:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147089:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147348:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784185105.147753:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.147759:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147771:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.147775:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.147780:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147791:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147800:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.147807:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149020:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784185105.149033:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149044:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158ce00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.149050:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149059:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149079:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149102:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4f61d6/0x63160f6fbe8b11aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149120:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784185105.149124:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149130:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158c200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.149133:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149140:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149151:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149158:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4db5323/0x63160f6fbe8b11b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149169:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185105.149182:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149189:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158cc00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185105.149199:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149215:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149227:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185105.149235:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.149237:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.149239:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784185105.151488:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1784185105.151660:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784185105.151670:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d82b1072/0x63160f6fbe8b11b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784185105.152454:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.152473:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.152489:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.152494:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.152501:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.152516:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.152526:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.152533:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.152544:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784185105.153246:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.153256:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.153268:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.153271:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.153282:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.153294:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.153303:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.153310:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.153319:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784185105.153681:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784185105.153690:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153699:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc158d600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185105.153704:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153714:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153734:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153741:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aae28bc/0x63160f6fbe8b11bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153757:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185105.153761:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153767:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185105.153770:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153785:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153795:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153801:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b11c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.153813:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.153815:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.153816:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.154902:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.154912:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.154925:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.154940:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.154947:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.154958:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.154968:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.154988:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.155011:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784185105.155351:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185105.155358:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.155366:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185105.155371:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.155379:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.155392:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.155409:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b11cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.155425:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.155427:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.155428:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.155727:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.155733:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.155743:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.155746:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.155751:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.155760:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.155768:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.155776:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.155797:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784185105.156060:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185105.156065:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.156073:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185105.156076:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.156083:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.156095:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.156103:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bbe032e/0x63160f6fbe8b11d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.156116:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.156117:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.156119:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185105.156507:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.158047:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.158058:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.158078:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.158083:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.158089:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.158102:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.158112:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.158119:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.158190:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784185105.159059:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.159067:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.159078:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.159082:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.159087:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.159097:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.159117:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.159124:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.159988:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784185105.159998:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160008:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185105.160013:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160024:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160042:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160050:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be7fbaea/0x63160f6fbe8b11db lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160070:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185105.160074:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160080:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185105.160083:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160091:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160114:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.160122:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.160124:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.160126:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.162434:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784185105.162451:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d89bde/0x63160f6fbe8b11e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.162493:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.163092:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.163101:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163116:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.163120:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.163127:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163141:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163152:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163172:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163216:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.163228:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.163233:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163241:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.163246:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163255:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163274:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163282:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b11e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163296:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.163297:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.163299:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.163733:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.163746:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163756:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.163759:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.163764:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163774:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163782:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163790:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163804:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.163811:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.163816:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163822:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.163826:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163834:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163850:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163858:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305ccec1/0x63160f6fbe8b11f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.163871:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.163872:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.163874:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.164232:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.164238:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164247:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.164250:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.164254:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164264:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164272:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164280:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164303:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.164310:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.164314:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164321:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970c00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.164325:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164370:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164382:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164390:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a7197a5/0x63160f6fbe8b11f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164401:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.164403:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.164404:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.164742:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.164748:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164757:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.164765:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.164770:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164780:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164788:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164796:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164807:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.164814:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.164818:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164824:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.164827:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164835:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164845:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164862:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034b6fdc3/0x63160f6fbe8b11fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.164875:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.164876:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.164878:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.165246:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.165251:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165260:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.165263:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.165267:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165275:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165284:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165290:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165304:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.165311:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.165321:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165328:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970a00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.165351:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165359:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165369:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165377:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912b55eb/0x63160f6fbe8b1205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165390:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.165391:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.165393:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.165773:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.165779:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165789:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.165793:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.165797:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165818:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165826:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165832:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165846:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185105.165855:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185105.165859:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165866:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185105.165870:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165878:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165889:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165896:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff697a6b/0x63160f6fbe8b120c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.165914:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.165915:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185105.165917:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185105.174521:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784185105.176114:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784185105.176126:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.176142:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1784185105.176146:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185105.176153:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.176167:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.176309:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.176318:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185105.176365:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1784185105.176622:0:14765:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:0.0:1784185105.176823:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185105.176830:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.176840:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185105.176845:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.176854:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.176871:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.176881:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000384fa3b6/0x63160f6fbe8b1213 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185105.176896:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.176898:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185105.176900:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185105.180136:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14151:x1870853265523200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 113686us (113863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185105.180151:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784185105.181185:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14151:1870853265523200:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784185105.181204:0:14151:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1784185105.181263:0:14151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14151:1870853265523328:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784185105.181319:0:14151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185105.181382:0:14151:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f84aae840 going to sleep for 11 seconds 00000100:00100000:2.0:1784185105.181401:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523328 00000100:00100000:2.0:1784185105.181407:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523328 00000100:00100000:2.0:1784185105.181448:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784185105.181457:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14151:x1870853265523328:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784185105.181502:0:14764:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1784185105.196316:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14151:x1870853265523328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14852us (14989us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784185105.197092:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784185105.197250:0:14151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14151:1870853265523328:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784185105.197266:0:14151:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1784185106.189543:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784185107.015729:0:15427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784185107.015734:0:15427:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784185107.015872:0:15427:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b5fb6ffa000 00000020:01000004:3.0:1784185107.015889:0:15427:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784185107.015902:0:15427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784185107.015916:0:15427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b5fb9330000) 00000020:00000080:3.0:1784185107.015933:0:15427:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784185107.044895:0:15427:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784185107.045116:0:15427:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784185107.045927:0:15427:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784185107.046148:0:15427:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784185107.048908:0:15427:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784185107.049309:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 512: rc = 0 00100000:10000000:2.0:1784185107.049704:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:2.0:1784185107.049802:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:2.0:1784185107.050288:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00100000:10000000:2.0:1784185107.051151:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:2.0:1784185107.054479:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:2.0:1784185107.054766:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:2.0:1784185107.055012:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1784185107.055740:0:15427:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00000020:00000080:2.0:1784185107.056313:0:15427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784185107.056326:0:15427:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784185107.056524:0:15427:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63160f6fbe8b1221 00000020:01000004:2.0:1784185107.056533:0:15427:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784185107.056554:0:15427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784185107.056557:0:15427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784185107.056563:0:15427:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784185107.056584:0:15427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784185107.056589:0:15427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784185107.073599:0:15427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784185107.073656:0:15427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1784185107.073661:0:15427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784185107.073662:0:15427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784185107.073664:0:15427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784185107.073665:0:15427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784185107.073667:0:15427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784185107.073668:0:15427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784185107.073669:0:15427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784185107.073671:0:15427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784185107.073672:0:15427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784185107.073676:0:15427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1784185107.073678:0:15427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784185107.073679:0:15427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784185107.073681:0:15427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784185107.073682:0:15427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784185107.073683:0:15427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784185107.073684:0:15427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784185107.073685:0:15427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784185107.073686:0:15427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784185107.073687:0:15427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784185107.073714:0:15427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784185107.073740:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523456:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784185107.073811:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185107.073862:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.073930:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523456 00000100:00100000:2.0:1784185107.073937:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523456 00000100:00100000:2.0:1784185107.074024:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784185107.074033:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:15427:x1870853265523456:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784185107.074060:0:14121:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784185107.074063:0:14121:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1784185107.074066:0:14121:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784185107.082196:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:15427:x1870853265523456:12345-0@lo:253:mount.lustre.0 Request processed in 8144us (8364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.082211:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784185107.082326:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523456:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784185107.082379:0:15427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784185107.082382:0:15427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784185107.082383:0:15427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784185107.082385:0:15427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784185107.082386:0:15427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784185107.082387:0:15427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784185107.082388:0:15427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784185107.082390:0:15427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784185107.082391:0:15427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784185107.082392:0:15427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784185107.082413:0:15427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b5fb6ffa000 from lustre-OST0001 10000000:01000000:3.0:1784185107.082440:0:15427:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784185107.082443:0:15427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784185107.082452:0:15427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b5fb722b380 local copy 00010000:00010000:3.0:1784185107.082462:0:15427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185107.082671:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185107.082706:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185107.082750:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185107.082984:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523584 00000100:00100000:0.0:1784185107.082990:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523584 00000100:00100000:0.0:1784185107.083030:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784185107.083039:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:15427:x1870853265523584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784185107.083317:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:15427:x1870853265523584:12345-0@lo:501:mount.lustre.0 Request processed in 278us (609us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784185107.083325:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784185107.083571:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523584:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784185107.083586:0:15427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784185107.083733:0:15427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784185107.083741:0:15427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.083761:0:15427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fc158c600/0x63160f6fbe8b0fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b0fce expref: -99 pid: 14110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784185107.083787:0:15427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b5fb6ffa000 10000000:01000000:3.0:1784185107.083804:0:15427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784185107.083809:0:15427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784185107.083811:0:15427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784185107.083815:0:15427:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784185107.083818:0:15427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784185107.083842:0:15427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8b1228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.083849:0:15427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8b1228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.083857:0:15427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8b1228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185107.083871:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784185107.083900:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185107.083934:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.084161:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523712 00000100:00100000:2.0:1784185107.084166:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523712 00000100:00100000:2.0:1784185107.084210:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784185107.084218:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:15427:x1870853265523712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185107.084228:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185107.084257:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8b122f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b1228 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.084280:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8b122f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b1228 expref: 17 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.084290:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93970e00/0x63160f6fbe8b122f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1228 expref: 17 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.084298:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970e00, rc 0) 00000100:00100000:2.0:1784185107.084367:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265523712:12345-0@lo:101:mount.lustre.0 Request processed in 150us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.084374:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784185107.084688:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784185107.084703:0:15427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8b1228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b122f expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.084711:0:15427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8b1228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b122f expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784185107.085512:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784185107.087132:0:15427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784185107.087392:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784185107.087429:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784185107.087455:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784185107.087491:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784185107.087519:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784185107.087544:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784185107.087593:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784185107.087599:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784185107.087682:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185107.087752:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185107.087798:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.087954:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523840 00000100:00100000:2.0:1784185107.087961:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523840 00000100:00100000:2.0:1784185107.087999:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784185107.088008:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265523840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185107.088402:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265523840:12345-0@lo:501:mount.lustre.0 Request processed in 394us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.088411:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784185107.088856:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784185107.088899:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784185107.088943:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185107.089014:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185107.091543:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265523968 00000100:00100000:0.0:1784185107.091557:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265523968 00000100:00100000:0.0:1784185107.091618:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784185107.091628:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265523968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185107.092208:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265523968:12345-0@lo:503:mount.lustre.0 Request processed in 579us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185107.092216:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784185107.094924:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265523968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784185107.096123:0:15427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784185107.096221:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784185107.096291:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185107.096434:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185107.098676:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524096 00000100:00100000:0.0:1784185107.098689:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524096 00000100:00100000:1.0:1784185107.098938:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784185107.098949:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265524096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784185107.099270:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265524096:12345-0@lo:502:mount.lustre.0 Request processed in 322us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185107.099278:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784185107.099623:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185107.099939:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784185107.099997:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784185107.100044:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784185107.100097:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784185107.100133:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784185107.100195:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784185107.100248:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784185107.100283:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784185107.100323:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1784185107.100541:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784185107.100592:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185107.100622:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784185107.100699:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524224 00000100:00100000:0.0:1784185107.100705:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524224 00000100:00100000:0.0:1784185107.100753:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784185107.100762:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265524224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784185107.101003:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265524224:12345-0@lo:502:mount.lustre.0 Request processed in 242us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185107.101011:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784185107.102790:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185107.103003:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1784185107.103018:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1784185107.113548:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784185107.113561:0:15428:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784185107.113569:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185107.113571:0:15428:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784185107.113580:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784185107.113594:0:15428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b5fb93319c0) 00000020:00000080:3.0:1784185107.113616:0:15428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784185107.113622:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784185107.113684:0:15428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fb6ffa000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784185107.113692:0:15428:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784185107.113702:0:15428:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x63160f6fbe8b123d 00010000:00010000:3.0:1784185107.117991:0:15428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1784185107.118720:0:15428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1784185107.121605:0:15428:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1784185107.123009:0:15428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784185107.123021:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784185107.123028:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185107.123037:0:15428:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784185107.123042:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784185107.123046:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185107.123047:0:15428:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784185107.123051:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784185107.123053:0:15428:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784185107.123055:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784185107.123058:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185107.123059:0:15428:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784185107.123062:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784185107.123064:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185107.123065:0:15428:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784185107.123069:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784185107.123118:0:15428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784185107.123121:0:15428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784185107.123122:0:15428:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784185107.123125:0:15428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1784185107.126468:0:15427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1784185107.126507:0:15427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784185107.126522:0:15427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8b1228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b122f expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.126541:0:15427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f9896ea00/0x63160f6fbe8b1228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b122f expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185107.126547:0:15427:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fb6ffa000 from 1 10000000:01000000:0.0:1784185107.126549:0:15427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784185107.126582:0:15427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.126587:0:15427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.126596:0:15427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185107.126619:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784185107.126680:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185107.126716:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.126846:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524352 00000100:00100000:2.0:1784185107.126853:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524352 00000100:00100000:2.0:1784185107.126905:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784185107.126913:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:15427:x1870853265524352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185107.126927:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185107.126941:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b1244 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.126963:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 18 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.126980:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 18 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.126989:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971e00, rc 0) 00000100:00100000:2.0:1784185107.127045:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524352:12345-0@lo:101:mount.lustre.0 Request processed in 133us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.127052:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784185107.127171:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784185107.127192:0:15427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.127198:0:15427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784185107.127586:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1784185107.127857:0:15427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784185107.128031:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1784185107.128069:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1784185107.128124:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1784185107.128130:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1784185107.128169:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784185107.128224:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185107.128254:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.128395:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524480 00000100:00100000:2.0:1784185107.128401:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524480 00000100:00100000:2.0:1784185107.128430:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784185107.128437:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185107.128628:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524480:12345-0@lo:501:mount.lustre.0 Request processed in 190us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.128636:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784185107.128781:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784185107.128874:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185107.128909:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185107.128970:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f88cd1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784185107.129009:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524608 00000100:00100000:1.0:1784185107.129014:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524608 00000100:00100000:1.0:1784185107.129081:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784185107.129089:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784185107.129402:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524608:12345-0@lo:503:mount.lustre.0 Request processed in 314us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185107.129409:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784185107.129483:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784185107.129894:0:15427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784185107.129950:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784185107.129985:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.130230:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524736 00000100:00100000:2.0:1784185107.130235:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524736 00000100:00100000:2.0:1784185107.130259:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784185107.130266:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784185107.130447:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524736:12345-0@lo:502:mount.lustre.0 Request processed in 181us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.130456:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784185107.130787:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f91fd6900 going to sleep for 11 seconds 00000100:00100000:0.0:1784185107.130870:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784185107.131123:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784185107.131187:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1784185107.131238:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1784185107.131277:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1784185107.131308:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1784185107.132472:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1784185107.132530:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1784185107.132565:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1784185107.132618:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784185107.132672:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185107.132711:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f91fd6900 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.132713:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524864 00000100:00100000:2.0:1784185107.132720:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524864 00000100:00100000:2.0:1784185107.132858:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784185107.132869:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784185107.133067:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524864:12345-0@lo:502:mount.lustre.0 Request processed in 199us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.133080:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784185107.133351:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784185107.133447:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784185107.133455:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1784185107.134117:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185107.134124:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185107.134125:0:15432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784185107.134129:0:15432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fb6ffa000 00000020:00000080:0.0:1784185107.134131:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784185107.134136:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185107.134137:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185107.134138:0:15432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784185107.134139:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185107.134141:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185107.134141:0:15432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784185107.134143:0:15432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b5fb6ffa000 00000020:00000080:0.0:1784185107.134144:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784185107.134225:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185107.134228:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185107.134229:0:15432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784185107.134231:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784185107.134232:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185107.134233:0:15432:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784185107.134235:0:15432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b5fb6ffa000 00000020:00000080:0.0:1784185107.134236:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784185107.138851:0:15432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784185107.138862:0:15432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784185107.138864:0:15432:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784185107.138869:0:15432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1784185107.139045:0:15427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1784185107.139071:0:15427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784185107.139088:0:15427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.139100:0:15427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185107.139147:0:15427:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784185107.139150:0:15427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b5fb6ffa000 10000000:01000000:2.0:1784185107.139154:0:15427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b5fb6ffa000 10000000:01000000:2.0:1784185107.139157:0:15427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784185107.139163:0:15427:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b5fb6ffa000 from 1 10000000:01000000:2.0:1784185107.139166:0:15427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784185107.139213:0:15427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971a00/0x63160f6fbe8b1252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.139222:0:15427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f93971a00/0x63160f6fbe8b1252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.139233:0:15427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f93971a00/0x63160f6fbe8b1252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185107.139256:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784185107.139318:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185107.139363:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265524992 00000100:00100000:0.0:1784185107.139371:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265524992 00000100:00100000:2.0:1784185107.139392:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f86467a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185107.139412:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784185107.139421:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:15427:x1870853265524992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784185107.139440:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185107.139454:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c000/0x63160f6fbe8b1259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b1252 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.139478:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c000/0x63160f6fbe8b1259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b1252 expref: 19 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.139488:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631c000/0x63160f6fbe8b1259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1252 expref: 19 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.139497:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c000, rc 0) 00000100:00100000:0.0:1784185107.139537:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265524992:12345-0@lo:101:mount.lustre.0 Request processed in 116us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185107.139543:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784185107.139579:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265524992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784185107.139592:0:15427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f93971a00/0x63160f6fbe8b1252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1259 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.139608:0:15427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f93971a00/0x63160f6fbe8b1252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b1259 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784185107.140296:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1784185107.140640:0:15427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784185107.140959:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784185107.141005:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784185107.141039:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784185107.141083:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784185107.141116:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784185107.141155:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784185107.141198:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784185107.141228:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784185107.141267:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784185107.141297:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784185107.141324:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784185107.141404:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784185107.141441:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784185107.141491:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784185107.141544:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784185107.141579:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784185107.141611:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784185107.141658:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784185107.141693:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784185107.141728:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784185107.141773:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784185107.141810:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784185107.141843:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784185107.141890:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784185107.141925:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1784185107.141957:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1784185107.142014:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1784185107.142050:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1784185107.142082:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1784185107.142139:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1784185107.142172:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1784185107.142220:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1784185107.142253:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1784185107.142301:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1784185107.142358:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1784185107.142406:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1784185107.142440:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1784185107.142517:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1784185107.142525:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1784185107.142618:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185107.142685:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.142743:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265525120 00000100:00100000:2.0:1784185107.142750:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265525120 00000100:00100000:2.0:1784185107.142794:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784185107.142802:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185107.143014:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525120:12345-0@lo:501:mount.lustre.0 Request processed in 211us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.143021:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784185107.143129:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f86467a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.143152:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784185107.144247:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784185107.144311:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.144426:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f86467a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185107.144522:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265525248 00000100:00100000:0.0:1784185107.144529:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265525248 00000100:00100000:0.0:1784185107.144563:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784185107.144571:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784185107.145034:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525248:12345-0@lo:503:mount.lustre.0 Request processed in 463us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185107.145042:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784185107.145823:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784185107.146431:0:15427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784185107.146501:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784185107.146554:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.146609:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265525376 00000100:00100000:2.0:1784185107.146614:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265525376 00000100:00100000:2.0:1784185107.146646:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784185107.146654:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784185107.146881:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525376:12345-0@lo:502:mount.lustre.0 Request processed in 227us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.146888:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784185107.146931:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784185107.146945:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784185107.147168:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784185107.147228:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784185107.147263:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784185107.147309:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784185107.147379:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784185107.147433:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784185107.147457:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784185107.147473:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784185107.147498:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784185107.147515:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784185107.147531:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784185107.147559:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784185107.147579:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784185107.147595:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784185107.147629:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784185107.147662:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784185107.147687:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784185107.147717:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784185107.147736:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784185107.147753:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784185107.147798:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784185107.147837:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784185107.147869:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784185107.147898:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784185107.147917:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1784185107.147934:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1784185107.147968:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1784185107.147990:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1784185107.148008:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1784185107.148031:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1784185107.148049:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1784185107.148066:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1784185107.148082:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1784185107.148105:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1784185107.148123:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1784185107.148146:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1784185107.148192:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1784185107.148232:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1784185107.148278:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1784185107.148313:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1784185107.148369:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784185107.148424:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.148466:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbfa8c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784185107.151280:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265525504 00000100:00100000:1.0:1784185107.151292:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265525504 00000100:00100000:1.0:1784185107.151365:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784185107.151376:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784185107.151605:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265525504:12345-0@lo:502:mount.lustre.0 Request processed in 231us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185107.151613:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784185107.151643:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265525504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784185107.151771:0:15427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1784185107.151787:0:15427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1784185107.153546:0:15437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784185107.153562:0:15437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b5f844f99c0) 00000020:00000080:2.0:1784185107.153580:0:15437:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1784185107.153773:0:15437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b5fb6ffa000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784185107.153777:0:15437:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b5fb6ffa000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784185107.153785:0:15437:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b5fb6ffa000 3 00010000:00080000:2.0:1784185107.153828:0:15437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b5e82dfe000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1784185107.155409:0:15437:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1784185107.155509:0:15437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784185107.155538:0:15437:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784185107.155548:0:15437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x63160f6fbe8b1267 00000100:00080000:2.0:1784185107.155557:0:15437:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784185107.155562:0:15437:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b5e82dfe000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784185107.155593:0:15437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbfbcce00 x1870853265525632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784185107.155613:0:15437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784185107.155658:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784185107.155661:0:1384:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784185107.155664:0:1384:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784185107.155667:0:1384:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1784185107.155671:0:1384:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784185107.155675:0:1384:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b5fb7d95000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784185107.155685:0:1384:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbfbcc380 x1870853265525888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784185107.155731:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265525760:0@lo:400:kworker.0 00000100:00100000:2.0:1784185107.155791:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.155839:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784185107.155845:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265526016:0@lo:400:kworker.0 00000100:00100000:2.0:1784185107.155869:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.155898:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265526144:0@lo:400:kworker.0 00000100:00100000:2.0:1784185107.155915:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.155959:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265525760 00000100:00100000:1.0:1784185107.155960:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526016 00000100:00100000:2.0:1784185107.155965:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265525760 00000100:00100000:1.0:1784185107.155965:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526016 00000100:00100000:2.0:1784185107.156007:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784185107.156015:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265525760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185107.156065:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526144 00000100:00100000:2.0:1784185107.156066:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265525760:12345-0@lo:400:kworker.0 Request processed in 52us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185107.156068:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526144 00000100:00100000:2.0:1784185107.156073:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784185107.156087:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784185107.156092:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784185107.156094:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265526016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185107.156097:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265526144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185107.156123:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265526016:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.156127:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265526144:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185107.156130:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784185107.156132:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1784185107.156161:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbfbcdc00 x1870853265526144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185107.156300:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1870853265525632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784185107.156346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185107.156370:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265525888:0@lo:8:kworker.0 00000100:00100000:0.0:1784185107.156389:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185107.156414:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265525888 00000100:00100000:1.0:1784185107.156418:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265525888 00000100:00100000:0.0:1784185107.156419:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265525632 00000100:00100000:0.0:1784185107.156422:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265525632 00000100:00100000:1.0:1784185107.156436:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784185107.156440:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1870853265525888:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1784185107.156446:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784185107.156449:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3312:x1870853265525632:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784185107.156463:0:15288:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000100:00100000:1.0:1784185107.156483:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1870853265525888:12345-0@lo:8:kworker.0 Request processed in 41us (92us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784185107.156489:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:0.0:1784185107.156491:0:15288:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x63160f6fbe8b126e 00000004:00100000:0.0:1784185107.156506:0:15288:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784185107.156534:0:15288:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784185107.156564:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1870853265525632:12345-0@lo:38:llog_process_th.0 Request processed in 113us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185107.156570:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784185107.156595:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbfbcce00 x1870853265525632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784185117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784185107.156604:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784185107.156610:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784185107.156617:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784185107.156621:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784185107.156623:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5e82dfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784185107.156628:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1870853265525632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784185107.156639:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784185107.156642:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784185107.156646:0:3312:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784185107.156649:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265525888:0@lo:8:kworker.0 00000100:00100000:2.0:1784185107.157192:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265526144:0@lo:400:kworker.0 00010000:00080000:2.0:1784185107.157239:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b5fbfbcd880 x1870853265526016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185107.157250:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265526016:0@lo:400:kworker.0 00000100:00100000:2.0:1784185107.157262:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265525760:0@lo:400:kworker.0 00000100:00080000:3.0:1784185107.157569:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784185107.157575:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1784185107.157976:0:15437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1784185107.158208:0:15427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784185107.158234:0:15427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784185107.158251:0:15427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93971a00/0x63160f6fbe8b1252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1259 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.158274:0:15427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f93971a00/0x63160f6fbe8b1252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1259 expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784185107.158316:0:15427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784185107.158318:0:15427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784185107.158319:0:15427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784185107.158321:0:15427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784185107.158322:0:15427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784185107.158323:0:15427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784185107.158325:0:15427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784185107.158327:0:15427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784185107.158328:0:15427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784185107.158367:0:15427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1784185107.158370:0:15427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784185107.158372:0:15427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784185107.158373:0:15427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784185107.158373:0:15427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784185107.158374:0:15427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784185107.158376:0:15427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784185107.158377:0:15427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784185107.158378:0:15427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784185107.158379:0:15427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784185107.158438:0:15427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784185107.158456:0:15427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265526272:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784185107.158512:0:15427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185107.158581:0:15427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e812f4300 going to sleep for 11 seconds 00000100:00100000:3.0:1784185107.158678:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526272 00000100:00100000:3.0:1784185107.158762:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526272 00000100:00100000:3.0:1784185107.158812:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784185107.158821:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265526272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784185107.158848:0:14121:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784185107.158864:0:14121:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784185107.184716:0:14121:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784185107.184734:0:14121:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784185107.184807:0:14144:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784185107.184812:0:14144:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784185107.184835:0:14144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.184855:0:14144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 19 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.184863:0:14144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.184908:0:14144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 19 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185107.185038:0:14144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 19 pid: 14123 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185107.185055:0:14144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf055500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14144:1870853265526400:0@lo:104: 00000100:00100000:0.0:1784185107.185122:0:14144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185107.185167:0:14144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f900d3180 going to sleep for 11 seconds 00000100:00100000:3.0:1784185107.185715:0:14111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526400 00000100:00100000:3.0:1784185107.185732:0:14111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526400 00000100:00100000:3.0:1784185107.185846:0:14111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784185107.185859:0:14111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14144:x1870853265526400:12345-0@lo:104: 00010000:00010000:3.0:1784185107.185872:0:14111:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.186001:0:14111:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784185107.186007:0:14111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:14144:x1870853265526400:12345-0@lo:104: Request processed in 152us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185107.186014:0:14111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784185107.186036:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784185107.186042:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.186050:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e600 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:3.0:1784185107.186053:0:14117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.186062:0:14117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784185107.186069:0:14117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784185107.186074:0:14117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784185107.186105:0:14117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.186112:0:14117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784185107.186488:0:14144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf055500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14144:1870853265526400:0@lo:104: 00010000:00010000:2.0:1784185107.186511:0:14144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185107.186652:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265526528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784185107.186693:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185107.186754:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526528 00000100:00100000:2.0:1784185107.186759:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526528 00010000:00010000:2.0:1784185107.186801:0:14115:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 20 pid: 14123 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185107.186826:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784185107.186833:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+20:3316:x1870853265526528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784185107.186843:0:14115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185107.186848:0:14115:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 20 pid: 14123 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186857:0:14115:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 20 pid: 14123 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186872:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b1141 expref: 20 pid: 14123 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186887:0:14115:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186894:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784185107.186908:0:14115:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002096577s 00010000:00010000:2.0:1784185107.186923:0:14115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186930:0:14115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186939:0:14115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186945:0:14115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186957:0:14115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185107.186961:0:14115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186968:0:14115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186981:0:14115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.186991:0:14115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784185107.187165:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.187189:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896e600/0x63160f6fbe8b1141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1148 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185107.187204:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185107.187206:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185107.187208:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185107.191293:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:15427:x1870853265526272:12345-0@lo:253:mount.lustre.0 Request processed in 32463us (32770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185107.191309:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784185107.191519:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:3316:x1870853265526528:12345-0@lo:103:ldlm_bl.0 Request processed in 4685us (4824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185107.191528:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784185107.191562:0:14144:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.191574:0:14144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185107.191581:0:14144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b1275 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185107.195408:0:15427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:15427:1870853265526272:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784185107.195431:0:15427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784185107.195451:0:15427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784185107.195453:0:15427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784185107.195455:0:15427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784185107.195456:0:15427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784185107.195458:0:15427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784185107.195459:0:15427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784185107.195461:0:15427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784185107.195462:0:15427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784185107.195463:0:15427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784185107.195481:0:15427:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784185107.198393:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3316:1870853265526528:0@lo:103:ldlm_bl.0 00080000:10000000:1.0:1784185107.199031:0:15427:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784185107.199195:0:15427:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784185107.199328:0:15427:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784185107.199502:0:15427:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784185107.199645:0:15427:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784185107.199867:0:15427:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784185107.201075:0:15427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1784185107.218504:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784185107.238964:0:15427:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1784185107.238974:0:15427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1784185107.239009:0:15427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784185107.239065:0:15427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784185107.239081:0:15427:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784185107.239108:0:15427:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1784185108.234497:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784185108.746465:0:14125:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784185108.746474:0:14125:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b5fbf5dc000 from 8 10000000:01000000:1.0:1784185108.746479:0:14125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784185108.746534:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b127c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185108.746547:0:14125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b127c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185108.746558:0:14125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b127c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185108.746585:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265526656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784185108.746657:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185108.746725:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87255d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784185108.747301:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526656 00000100:00100000:0.0:1784185108.747310:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526656 00000100:00100000:0.0:1784185108.747379:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784185108.747389:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:14125:x1870853265526656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784185108.747404:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185108.747421:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b1283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b127c expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185108.747446:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b1283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b127c expref: 19 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185108.747456:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d400/0x63160f6fbe8b1283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b127c expref: 19 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185108.747465:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d400, rc 0) 00000100:00100000:0.0:1784185108.747507:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265526656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185108.747528:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784185108.750999:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265526656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784185108.751049:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b127c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1283 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185108.751062:0:14125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b127c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b1283 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185108.751134:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265526784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784185108.751209:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185108.751253:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87255d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784185108.751375:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526784 00000100:00100000:3.0:1784185108.751382:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526784 00000100:00100000:3.0:1784185108.751427:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784185108.751436:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265526784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784185108.751457:0:14121:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784185108.751473:0:14121:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784185108.751476:0:14121:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1784185108.751556:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265526784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185108.751564:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784185108.751907:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265526784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784185108.751981:0:14125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784185108.751988:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b127c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1283 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185108.751997:0:14125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9000/0x63160f6fbe8b127c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b1283 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185109.258429:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784185109.301470:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1784185109.301536:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784185110.219828:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784185110.219852:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265526912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784185110.219919:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185110.222198:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265526912 00000100:00100000:3.0:1784185110.222214:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265526912 00000100:00100000:3.0:1784185110.222299:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784185110.222309:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265526912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784185110.222371:0:14766:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784185110.222451:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265526912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185110.222459:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1784185110.222573:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784185110.222608:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1784185110.222636:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265526912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784185110.282814:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185111.308200:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784185112.271461:0:1384:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784185112.271469:0:1384:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784185112.271472:0:1384:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784185112.271485:0:1384:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b5fb7d95000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1784185112.271508:0:1384:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b5fbfbcfb80 x1870853265527296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784185112.271576:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265527040:0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.271651:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185112.271710:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265527680:0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.271739:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185112.271768:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784185112.271773:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265527552:0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.271795:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185112.271820:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265527168:0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.271845:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185112.271866:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784185112.271871:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265527424:0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.271891:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185112.271936:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527680 00000100:00100000:2.0:1784185112.272188:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527680 00000100:00100000:2.0:1784185112.272243:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527552 00000100:00100000:2.0:1784185112.272246:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527552 00000100:00100000:2.0:1784185112.272260:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527424 00000100:00100000:2.0:1784185112.272262:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527424 00000100:00100000:2.0:1784185112.272276:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784185112.272284:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265527680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.272359:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265527680:12345-0@lo:400:kworker.0 Request processed in 75us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185112.272368:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784185112.272384:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784185112.272390:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265527552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.272429:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265527552:12345-0@lo:400:kworker.0 Request processed in 40us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185112.272435:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784185112.272511:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784185112.272518:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265527424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.272553:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265527424:12345-0@lo:400:kworker.0 Request processed in 36us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185112.272559:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784185112.272578:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527168 00000100:00100000:2.0:1784185112.272581:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527168 00000100:00100000:2.0:1784185112.272607:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784185112.272613:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265527168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.272646:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265527168:12345-0@lo:400:kworker.0 Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185112.272651:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784185112.272667:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784185112.272671:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784185112.272697:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbcd180 x1870853265527552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185112.272709:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265527552:0@lo:400:kworker.0 00010000:00080000:2.0:1784185112.272720:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbcc380 x1870853265527680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185112.272727:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265527680:0@lo:400:kworker.0 00010000:00080000:2.0:1784185112.272755:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbcc700 x1870853265527424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784185128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784185112.272774:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265527424:0@lo:400:kworker.0 00000100:00100000:2.0:1784185112.272789:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265527168:0@lo:400:kworker.0 00000100:00100000:3.0:1784185112.273160:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527040 00000100:00100000:3.0:1784185112.273165:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527040 00000100:00100000:3.0:1784185112.273194:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784185112.273200:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265527040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185112.273241:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265527040:12345-0@lo:400:kworker.0 Request processed in 41us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185112.273248:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784185112.273291:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265527040:0@lo:400:kworker.0 00000100:00100000:0.0:1784185112.274166:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265527296:0@lo:8:kworker.0 00000100:00100000:0.0:1784185112.274213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185112.274269:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527296 00000100:00100000:0.0:1784185112.274274:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527296 00000100:00100000:0.0:1784185112.274299:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784185112.274305:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1870853265527296:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784185112.274349:0:14763:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1784185112.274379:0:14763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x63160f6fbe8b128a 00002000:00100000:0.0:1784185112.274392:0:14763:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b5fb74a8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784185112.274397:0:14763:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784185112.274400:0:14763:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784185112.274853:0:14763:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784185112.274878:0:14763:0:(import.c:65:import_set_state_nolock()) ffff9b5fb74ab800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784185112.275054:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1870853265527296:12345-0@lo:8:kworker.0 Request processed in 747us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185112.275062:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784185112.281174:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbfbcfb80 x1870853265527296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784185137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784185112.281197:0:3312:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784185112.281206:0:3312:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784185112.281212:0:3312:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784185112.281215:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9b5fb7d95000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784185112.281237:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784185112.281259:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1870853265527296:0@lo:8:kworker.0 00000004:00080000:3.0:1784185112.281530:0:14153:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1784185112.281551:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14153:1870853265527936:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784185112.281613:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185112.281642:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fbc3b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185112.281657:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265527808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784185112.281712:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185112.281742:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527936 00000100:00100000:3.0:1784185112.281747:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527936 00000100:00100000:3.0:1784185112.281798:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784185112.281806:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14153:x1870853265527936:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784185112.287084:0:14152:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784185112.287498:0:14152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 510453165512ns, next at 0ns, rc = 0 00002000:00080000:3.0:1784185112.290382:0:14765:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784185112.290395:0:14765:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1784185112.290401:0:14765:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:0.0:1784185112.294821:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265527808 00000100:00100000:0.0:1784185112.294836:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265527808 00000100:00100000:0.0:1784185112.294906:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784185112.294916:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1870853265527808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784185112.295805:0:14766:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185112.295892:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1870853265527808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 978us (14179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185112.295909:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784185112.304535:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784185112.304594:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b5fbf50e300 x1870853265527808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784185128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784185112.304622:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265527808:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1784185112.305797:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.305808:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.305824:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.305829:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.305836:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.305870:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.305881:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.305890:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.306853:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784185112.306872:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784185112.306880:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.306891:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784185112.306896:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.306905:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.307206:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.307214:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b1291 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.307248:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185112.307250:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185112.307252:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784185112.308237:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.308246:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.308259:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.308264:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.308271:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.308284:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.308294:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.308302:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.308389:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.309147:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.309154:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.309176:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.309179:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.309184:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.309195:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.309203:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.309211:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312213:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784185112.312228:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312241:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185112.312247:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312258:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312284:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312292:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d67f984/0x63160f6fbe8b1298 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312323:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185112.312327:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312358:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185112.312362:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312384:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312394:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185112.312402:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185112.312404:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185112.312406:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185112.316255:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784185112.316269:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b129f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.316355:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784185112.317737:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.317749:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.317765:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.317770:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.317777:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.317800:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.317811:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.317820:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.317886:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.318459:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.318467:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.318480:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.318484:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.318489:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.318498:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.318506:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.318524:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319168:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185112.319178:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319187:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fc00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.319192:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319202:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319222:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319230:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c31abe5/0x63160f6fbe8b12a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319251:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.319254:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319260:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.319263:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319278:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319288:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.319295:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.319296:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.319298:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185112.319533:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784185112.319540:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d79032e/0x63160f6fbe8b12ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784185112.320512:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.320521:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.320535:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.320539:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.320545:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.320557:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.320566:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.320572:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.320597:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185112.321133:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.321142:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.321151:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.321155:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.321164:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.321180:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.321187:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c0ae746/0x63160f6fbe8b12b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.321217:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.321219:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.321221:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.321227:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784185112.322393:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.322406:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.322421:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.322425:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.322432:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.322444:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.322453:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.322461:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.322478:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185112.323229:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.323237:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.323246:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.323250:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.323260:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.323276:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.323284:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7fbafc/0x63160f6fbe8b12bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.323303:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.323305:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.323307:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784185112.323380:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.323386:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323395:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.323405:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.323410:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323419:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323427:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323434:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323448:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.323838:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.323844:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323853:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.323857:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.323862:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323871:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323878:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323890:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.323903:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784185112.324529:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.324536:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.324546:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.324549:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.324553:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.324562:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.324569:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.324575:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.324584:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784185112.325396:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784185112.325404:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325422:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896ec00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.325426:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325436:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325453:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325461:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f74ae9b5/0x63160f6fbe8b12c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325479:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185112.325483:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325489:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896e200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.325491:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325499:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325508:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325522:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3f78e5/0x63160f6fbe8b12c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325534:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.325538:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325545:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2169800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.325548:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325555:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325565:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325571:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4f50889/0x63160f6fbe8b12d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.325583:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.325585:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.325586:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.325593:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784185112.327486:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.327498:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.327524:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.327529:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.327536:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.327548:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.327558:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.327565:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.327583:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.329809:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.329824:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.329842:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.329847:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.329854:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.329868:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.329890:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.329899:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.329916:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784185112.330115:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185112.330124:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330139:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2169000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.330144:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330152:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330170:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330179:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa27d7b/0x63160f6fbe8b12d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330200:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.330203:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330210:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2169400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.330213:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330222:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330231:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330243:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebbdd88d/0x63160f6fbe8b12de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.330256:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.330258:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.330259:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.331754:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.331889:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784185112.334357:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.334370:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334388:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.334393:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.334400:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334415:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334425:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334433:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334461:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.334893:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.334900:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334909:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.334912:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.334917:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334927:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.334935:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.335187:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185112.335201:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.335210:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2168200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185112.335214:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.335223:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.335242:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.335250:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e8298fa/0x63160f6fbe8b12e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.335269:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.335271:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.335272:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185112.336101:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.337648:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.340308:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.340323:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.340353:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.340364:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.340372:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.340388:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.340398:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.340406:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345068:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784185112.345083:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345105:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2168400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185112.345111:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345136:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345158:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345166:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a050aaf/0x63160f6fbe8b12ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345193:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185112.345196:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345203:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896f600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185112.345206:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345214:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345223:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.345230:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.345232:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.345239:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185112.347684:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784185112.347702:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c613fe4d/0x63160f6fbe8b12f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784185112.348982:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.348994:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349011:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.349015:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.349022:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349036:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349053:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349061:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349080:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.349489:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.349495:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349505:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.349508:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.349513:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349522:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349530:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349538:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349559:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784185112.349940:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.349946:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349955:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.349959:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.349963:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349972:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349981:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349988:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.349997:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784185112.350389:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.350396:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350406:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.350414:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.350419:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350428:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350436:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350443:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350452:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784185112.350831:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.350836:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350845:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.350848:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.350852:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350861:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350869:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350881:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.350889:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1784185112.352441:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784185112.352455:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352466:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fa00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.352471:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352480:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352500:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352509:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e5a9f12/0x63160f6fbe8b12fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352534:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784185112.352538:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352555:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164a000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.352558:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352566:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352577:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352583:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6595df4/0x63160f6fbe8b1301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352597:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784185112.352600:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352607:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164ae00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.352610:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352618:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352626:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352638:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7ad6ee/0x63160f6fbe8b1308 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352651:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185112.352655:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352661:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164a800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.352664:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352671:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352681:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352687:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000249392e2/0x63160f6fbe8b130f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352698:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.352702:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352709:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164a200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.352717:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352726:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352736:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352742:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040876b5e/0x63160f6fbe8b1316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.352754:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.352756:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.352758:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.358208:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784185112.360807:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.360822:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.360843:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.360849:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.360856:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.360872:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.360883:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.360891:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.360925:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.362712:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.362724:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.362746:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.362751:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.362757:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.362772:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.362781:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.362789:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.362808:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784185112.363101:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784185112.363109:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363118:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164ba00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185112.363122:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363131:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363149:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363157:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b131d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363175:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784185112.363179:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363186:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185112.363189:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363208:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363219:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363227:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e873a0cc/0x63160f6fbe8b1324 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185112.363240:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.363242:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.363244:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185112.363251:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784185112.363411:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1784185112.367788:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.367802:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.367819:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.367823:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.367830:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.367844:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.367868:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.367875:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.369161:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.369758:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.369767:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.369782:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.369787:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.369793:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.369806:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.369816:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.369823:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372714:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185112.372729:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372744:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.372750:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372761:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372780:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372798:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b33427e/0x63160f6fbe8b132b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372826:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.372830:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372838:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164a600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.372841:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372849:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372861:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.372868:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.372870:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.372872:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784185112.372961:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784185112.372970:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a8f5201/0x63160f6fbe8b1332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784185112.373623:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.373631:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.373644:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.373648:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.373655:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.373667:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.373677:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.373684:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.373698:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784185112.374066:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.374073:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374099:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.374103:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.374107:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374117:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374125:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374133:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374144:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784185112.374540:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784185112.374547:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374557:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1784185112.374560:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185112.374564:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374573:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374592:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374600:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185112.374609:0:14765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1784185112.374765:0:14765:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1784185112.374870:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14153:x1870853265527936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93060us (93252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185112.374880:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784185112.374945:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14153:1870853265527936:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784185112.374960:0:14153:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1784185112.375010:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14153:1870853265528064:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784185112.375044:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185112.375085:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5e820fdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784185112.375117:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528064 00000100:00100000:3.0:1784185112.375122:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528064 00000100:00100000:3.0:1784185112.375156:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784185112.375163:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14153:x1870853265528064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784185112.375200:0:14764:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1784185112.376263:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784185112.376273:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376284:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.376296:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376306:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376325:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376348:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004be53a69/0x63160f6fbe8b1339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376368:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784185112.376372:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376378:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b000 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.376382:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376389:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376399:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376406:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b134b538/0x63160f6fbe8b1340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376425:0:14116:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185112.376429:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376436:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185112.376439:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376446:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376456:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376463:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3dd5eb9/0x63160f6fbe8b1347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185112.376475:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.376477:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.376478:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185112.376485:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185112.382619:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14153:x1870853265528064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7448us (7568us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784185112.382633:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784185112.384599:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14153:1870853265528064:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784185112.384618:0:14153:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:1.0:1784185112.586944:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784185113.355503:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784185113.547825:0:15781:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784185114.378633:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185115.339230:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265528192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784185115.339317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185115.339608:0:14767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528192 00000100:00100000:2.0:1784185115.339630:0:14767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528192 00000100:00100000:2.0:1784185115.339805:0:14767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784185115.339816:0:14767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265528192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784185115.339852:0:14767:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784185115.339918:0:14767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265528192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185115.339925:0:14767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1784185115.339981:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784185115.340019:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265528192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784185115.404329:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185115.932292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185115.932978:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239317888 00000100:00100000:1.0:1784185115.932989:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239317888 00000100:00100000:1.0:1784185115.933112:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:1.0:1784185115.933120:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1870853239317888:12345-192.168.201.29@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784185115.933146:0:14123:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b17f98c2-fa7f-4904-ad4f-e776c7eb9c73@192.168.201.29@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1784185115.933178:0:14123:0:(genops.c:1406:class_connect()) connect: client b17f98c2-fa7f-4904-ad4f-e776c7eb9c73, cookie 0x63160f6fbe8b134e 00000100:00080000:1.0:1784185115.933296:0:14123:0:(import.c:65:import_set_state_nolock()) ffff9b5fa0450000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784185115.933400:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+5:2352:x1870853239317888:12345-192.168.201.29@tcp:250:mount.lustre.0 Request processed in 279us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185115.933408:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:2.0:1784185115.943459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185115.943544:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318016 00000100:00100000:3.0:1784185115.943554:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318016 00000100:00100000:3.0:1784185115.943604:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:3.0:1784185115.943614:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+5:13713:x1870853239318016:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784185115.943631:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185115.943651:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b1355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de96268381871f9 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185115.943681:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b1355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871f9 expref: 6 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185115.943692:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a400/0x63160f6fbe8b1355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381871f9 expref: 6 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185115.943702:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a400, rc 0) 00000100:00100000:3.0:1784185115.943764:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+6:13713:x1870853239318016:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 152us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185115.943771:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:0.0:1784185115.958268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185115.958361:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318144 00000100:00100000:3.0:1784185115.958372:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318144 00000100:00100000:3.0:1784185115.958429:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:3.0:1784185115.958439:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+6:13713:x1870853239318144:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784185115.958823:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+6:13713:x1870853239318144:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 384us (564us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784185115.958839:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1784185115.972891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185115.973304:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318272 00000100:00100000:0.0:1784185115.973317:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318272 00000100:00100000:0.0:1784185115.973443:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1784185115.973456:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+6:13713:x1870853239318272:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784185115.973481:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185115.973504:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b135c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838187200 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185115.973537:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b135c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187200 expref: 7 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185115.973549:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631c600/0x63160f6fbe8b135c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187200 expref: 7 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185115.973572:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c600, rc 0) 00000100:00100000:0.0:1784185115.973643:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+7:13713:x1870853239318272:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 189us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185115.973658:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:2.0:1784185115.995928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185115.996165:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318400 00000100:00100000:0.0:1784185115.996176:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318400 00000100:00100000:0.0:1784185115.996269:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:0.0:1784185115.996280:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+7:13713:x1870853239318400:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784185115.996620:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13713:x1870853239318400:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 340us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185115.996628:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:1.0:1784185116.011473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185116.011671:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318528 00000100:00100000:0.0:1784185116.011681:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318528 00000100:00100000:0.0:1784185116.011736:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1784185116.011747:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13713:x1870853239318528:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784185116.012179:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13713:x1870853239318528:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 431us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185116.012188:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:2.0:1784185116.016935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185116.018675:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318656 00000100:00100000:0.0:1784185116.018691:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318656 00000100:00100000:0.0:1784185116.018763:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1784185116.018773:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13731:x1870853239318656:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784185116.019168:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13731:x1870853239318656:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 395us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185116.019188:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:2.0:1784185116.039891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185116.040025:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318784 00000100:00100000:3.0:1784185116.040066:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318784 00000100:00100000:3.0:1784185116.040124:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1784185116.040134:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13731:x1870853239318784:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784185116.041732:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13731:x1870853239318784:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 1591us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185116.041745:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:2.0:1784185116.067742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185116.067848:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239318912 00000100:00100000:1.0:1784185116.067858:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239318912 00000100:00100000:1.0:1784185116.067922:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:1.0:1784185116.067932:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+8:13713:x1870853239318912:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784185116.067948:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185116.067965:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd8e00/0x63160f6fbe8b1363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de962683818722a expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185116.067992:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd8e00/0x63160f6fbe8b1363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818722a expref: 9 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185116.068003:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd8e00/0x63160f6fbe8b1363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818722a expref: 9 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185116.068019:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8e00, rc 0) 00000100:00100000:1.0:1784185116.068078:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+9:13713:x1870853239318912:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185116.068086:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:0.0:1784185116.079998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185116.080163:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319040 00000100:00100000:2.0:1784185116.080176:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319040 00000100:00100000:2.0:1784185116.080240:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:2.0:1784185116.080251:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+9:13713:x1870853239319040:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784185116.080277:0:14122:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784185116.080303:0:14122:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784185116.080307:0:14122:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784185116.080310:0:14122:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784185116.080313:0:14122:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1784185116.091139:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+9:13713:x1870853239319040:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 10878us (11145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185116.091154:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:3.0:1784185116.096824:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185116.097851:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319168 00000100:00100000:0.0:1784185116.097863:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319168 00000100:00100000:0.0:1784185116.097934:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:0.0:1784185116.097945:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+9:13713:x1870853239319168:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784185116.097962:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185116.097981:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838187231 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185116.098010:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 10 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185116.098021:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 10 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185116.098039:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631ce00, rc 0) 00000100:00100000:0.0:1784185116.098107:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13713:x1870853239319168:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 163us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185116.098114:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:0.0:1784185116.104044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185116.104176:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319296 00000100:00100000:3.0:1784185116.104186:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319296 00000100:00100000:3.0:1784185116.104242:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1784185116.104252:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13713:x1870853239319296:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784185116.112048:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13713:x1870853239319296:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 7786us (8014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185116.112074:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:2.0:1784185116.123814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185116.123970:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319424 00000100:00100000:1.0:1784185116.123980:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319424 00000100:00100000:1.0:1784185116.124047:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:1.0:1784185116.124058:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13713:x1870853239319424:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784185116.124631:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13713:x1870853239319424:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 572us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185116.124640:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:2.0:1784185116.134612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185116.134716:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319552 00000100:00100000:0.0:1784185116.134727:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319552 00000100:00100000:0.0:1784185116.134791:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:0.0:1784185116.134802:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13737:x1870853239319552:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784185116.135125:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13737:x1870853239319552:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 323us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185116.135140:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:0.0:1784185116.138980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185116.140156:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319680 00000100:00100000:1.0:1784185116.140185:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319680 00000100:00100000:1.0:1784185116.140249:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:1.0:1784185116.140260:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13737:x1870853239319680:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784185116.140558:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13737:x1870853239319680:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 298us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185116.140567:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:2.0:1784185116.161425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185116.162051:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319808 00000100:00100000:1.0:1784185116.162064:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319808 00000100:00100000:1.0:1784185116.162113:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1784185116.162121:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1870853239319808:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784185116.162153:0:14129:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 111c6c5d-699b-4985-bb82-f380714e1544@192.168.201.29@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1784185116.162206:0:14129:0:(genops.c:1406:class_connect()) connect: client 111c6c5d-699b-4985-bb82-f380714e1544, cookie 0x63160f6fbe8b1371 00000004:00100000:1.0:1784185116.162240:0:14129:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1784185116.162246:0:14129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1784185116.220309:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b5e82dff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784185116.220575:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+6:2352:x1870853239319808:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 58451us (59159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185116.220586:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1784185116.225849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185116.225919:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185116.226060:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239319936 00000100:00100000:0.0:1784185116.226070:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239319936 00000100:00100000:0.0:1784185116.226133:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320064 00000100:00100000:0.0:1784185116.226136:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320064 00000100:00100000:0.0:1784185116.226165:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:0.0:1784185116.226174:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:0:x1870853239319936:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784185116.226221:0:14128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784185116.226319:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:0:x1870853239319936:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 145us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185116.226327:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:0.0:1784185116.226361:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1784185116.226368:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+6:13713:x1870853239320064:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784185116.226378:0:14128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784185116.226397:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+6:13713:x1870853239320064:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185116.226402:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:3.0:1784185116.227045:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185116.228922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185116.230010:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320192 00000100:00100000:2.0:1784185116.230022:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320192 00000100:00100000:2.0:1784185116.230085:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1784185116.230095:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+6:13713:x1870853239320192:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784185116.230473:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+6:13713:x1870853239320192:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 378us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185116.230482:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1784185116.236965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185116.237078:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320320 00000100:00100000:2.0:1784185116.237089:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320320 00000100:00100000:2.0:1784185116.237151:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1784185116.237159:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1870853239320320:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784185116.237195:0:14763:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 111c6c5d-699b-4985-bb82-f380714e1544@192.168.201.29@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1784185116.237228:0:14763:0:(genops.c:1406:class_connect()) connect: client 111c6c5d-699b-4985-bb82-f380714e1544, cookie 0x63160f6fbe8b1378 00002000:00100000:2.0:1784185116.237240:0:14763:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 111c6c5d-699b-4985-bb82-f380714e1544/ffff9b5e82dfa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784185116.237267:0:14763:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784185116.237824:0:14763:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784185116.237858:0:14763:0:(import.c:65:import_set_state_nolock()) ffff9b5e82dfc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784185116.237929:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+6:2352:x1870853239320320:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 768us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185116.237937:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1784185116.242012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185116.242077:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185116.242197:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320448 00000100:00100000:0.0:1784185116.242207:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320448 00000100:00100000:0.0:1784185116.242257:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1784185116.242264:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239320448:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784185116.242297:0:14764:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 111c6c5d-699b-4985-bb82-f380714e1544@192.168.201.29@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:0.0:1784185116.242378:0:14764:0:(genops.c:1406:class_connect()) connect: client 111c6c5d-699b-4985-bb82-f380714e1544, cookie 0x63160f6fbe8b137f 00002000:00100000:0.0:1784185116.242392:0:14764:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 111c6c5d-699b-4985-bb82-f380714e1544/ffff9b5fb6fd2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784185116.242416:0:14764:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784185116.242599:0:14764:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784185116.242629:0:14764:0:(import.c:65:import_set_state_nolock()) ffff9b5fb6fd5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784185116.242710:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:111c6c5d-699b-4985-bb82-f380714e1544+6:2352:x1870853239320448:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 445us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185116.242718:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1784185116.243448:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320576 00000100:00100000:1.0:1784185116.243455:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320576 00000100:00100000:1.0:1784185116.243500:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1784185116.243508:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+6:13713:x1870853239320576:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00080000:2.0:1784185116.245621:0:14131:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2050us 00000004:00200000:1.0:1784185116.277195:0:14131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1784185116.277548:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+6:13713:x1870853239320576:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 34034us (35464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185116.277559:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00010000:00010000:2.0:1784185116.429922:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185116.541195:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185116.543114:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320704 00000100:00100000:2.0:1784185116.543130:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320704 00000100:00100000:2.0:1784185116.543292:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1784185116.543303:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+6:13758:x1870853239320704:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:2.0:1784185116.543357:0:15288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185116.543386:0:15288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b1386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818725b expref: -99 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185116.543456:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8b138d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185116.543471:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8b138d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185116.543483:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8b138d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185116.543889:0:15288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784185116.543894:0:15288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185116.543987:0:15288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8b138d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185116.544032:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b1386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818725b expref: 8 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185116.544051:0:15288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8b138d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818725b expref: 7 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185116.544060:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:2.0:1784185116.544062:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784185116.544066:0:15288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971800, rc 0) 00000100:00100000:2.0:1784185116.544141:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+7:13758:x1870853239320704:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 839us (2954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185116.544148:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1784185117.386774:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265528576:0@lo:400:kworker.0 00000100:00100000:0.0:1784185117.386774:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784185117.386834:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265528448:0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.386982:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185117.387039:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265529088:0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.387083:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185117.387108:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784185117.387114:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265528704:0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.387135:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185117.387188:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528576 00000100:00100000:1.0:1784185117.387195:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528576 00000100:00100000:1.0:1784185117.387246:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528704 00000100:00100000:1.0:1784185117.387249:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528704 00000100:00100000:1.0:1784185117.387267:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784185117.387275:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265528576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.387377:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265528576:12345-0@lo:400:kworker.0 Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185117.387384:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784185117.387401:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784185117.387407:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1870853265528704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.387434:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1870853265528704:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185117.387440:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784185117.387492:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265528704:0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.387502:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265528576:0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.387538:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529088 00000100:00100000:1.0:1784185117.387542:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529088 00000100:00100000:1.0:1784185117.387570:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784185117.387576:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265529088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185117.387611:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1870853265529088:12345-0@lo:400:kworker.0 Request processed in 36us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185117.387628:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784185117.387656:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1870853265529088:0@lo:400:kworker.0 00000100:00100000:0.0:1784185117.394509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185117.394563:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528320 00000100:00100000:0.0:1784185117.394571:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528320 00000100:00100000:0.0:1784185117.394625:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185117.394635:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265528320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784185117.394661:0:14766:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185117.394707:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1870853265528320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185117.394715:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185117.394769:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbf50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784185117.394782:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265528832:0@lo:400:kworker.0 00000100:00100000:0.0:1784185117.394814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185117.394849:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528832 00000100:00100000:0.0:1784185117.394853:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528832 00000100:00080000:3.0:1784185117.396288:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185117.396386:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784185117.402399:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185117.402470:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265528960:0@lo:400:kworker.0 00000100:00100000:2.0:1784185117.402500:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185117.402528:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528960 00000100:00100000:2.0:1784185117.402535:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528960 00000100:00080000:3.0:1784185117.406994:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784185117.407001:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784185117.407301:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265528448 00000100:00100000:3.0:1784185117.407313:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265528448 00000100:00100000:3.0:1784185117.407386:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784185117.407397:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185117.407489:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265528448:12345-0@lo:400:kworker.0 Request processed in 93us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185117.407508:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784185117.407576:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265528448:0@lo:400:kworker.0 00000100:00100000:0.0:1784185117.407708:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185117.407762:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1870853265528832:12345-0@lo:400:kworker.0 Request processed in 11368us (12947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185117.407770:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784185117.408132:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784185117.408139:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185117.408184:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265528960:12345-0@lo:400:kworker.0 Request processed in 45us (5683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185117.408191:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1784185117.408208:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784185117.408235:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265528960:0@lo:400:kworker.0 00000100:00100000:0.0:1784185117.413394:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1870853265528832:0@lo:400:kworker.0 00010000:00010000:0.0:1784185117.451233:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784185117.495795:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 111c6c5d-699b-4985-bb82-f380714e1544 00000001:00100000:2.0:1784185117.495810:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784185117.495823:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1784185118.474670:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185118.746919:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185118.747109:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320832 00000100:00100000:3.0:1784185118.747120:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320832 00000100:00100000:3.0:1784185118.747211:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784185118.747222:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+7:13810:x1870853239320832:12345-192.168.201.29@tcp:41:lfs.0 00000004:00000024:3.0:1784185118.747274:0:15288:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1784185118.747452:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185118.749143:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+7:13810:x1870853239320832:12345-192.168.201.29@tcp:41:lfs.0 Request processed in 1913us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185118.749158:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784185118.752871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185118.754153:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239320960 00000100:00100000:0.0:1784185118.754170:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239320960 00000100:00100000:0.0:1784185118.754293:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00080000:2.0:1784185118.754299:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784185118.754311:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:111c6c5d-699b-4985-bb82-f380714e1544+6:13810:x1870853239320960:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:0.0:1784185118.754390:0:14766:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185118.754514:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:111c6c5d-699b-4985-bb82-f380714e1544+6:13810:x1870853239320960:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 209us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185118.754522:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1784185118.756837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185118.757088:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321088 00000100:00100000:0.0:1784185118.757098:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321088 00000100:00080000:2.0:1784185118.757223:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784185118.757265:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1784185118.757278:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:111c6c5d-699b-4985-bb82-f380714e1544+5:13810:x1870853239321088:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:0.0:1784185118.757318:0:14766:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185118.757445:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:111c6c5d-699b-4985-bb82-f380714e1544+5:13810:x1870853239321088:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 169us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185118.757454:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1784185118.988955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185118.989070:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321216 00000100:00100000:1.0:1784185118.989080:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321216 00000100:00100000:1.0:1784185118.989141:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:1.0:1784185118.989150:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb80d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+10:13843:x1870853239321216:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784185118.989167:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185118.989185:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd8000/0x63160f6fbe8b1394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838187262 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185118.989213:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd8000/0x63160f6fbe8b1394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187262 expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185118.989225:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd8000/0x63160f6fbe8b1394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187262 expref: 11 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185118.989234:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8000, rc 0) 00000100:00100000:1.0:1784185118.989294:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb80d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13843:x1870853239321216:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 145us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185118.989301:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:3.0:1784185118.997265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185118.997490:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321344 00000100:00100000:0.0:1784185118.997501:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321344 00000100:00100000:0.0:1784185118.997625:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:0.0:1784185118.997637:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13843:x1870853239321344:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784185118.997977:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13843:x1870853239321344:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 341us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185118.997995:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:2.0:1784185119.012109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185119.016846:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321472 00000100:00100000:3.0:1784185119.016860:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321472 00000100:00100000:3.0:1784185119.016938:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:3.0:1784185119.016950:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13843:x1870853239321472:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784185119.017225:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13843:x1870853239321472:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 275us (5122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185119.017233:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:2.0:1784185119.023866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185119.024119:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321600 00000100:00100000:0.0:1784185119.024130:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321600 00000100:00100000:0.0:1784185119.024189:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:0.0:1784185119.024200:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13849:x1870853239321600:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784185119.024734:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13849:x1870853239321600:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 535us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.024743:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:0.0:1784185119.064666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185119.064817:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321728 00000100:00100000:1.0:1784185119.064828:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321728 00000100:00100000:1.0:1784185119.064904:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:1.0:1784185119.064914:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13849:x1870853239321728:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784185119.067854:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13849:x1870853239321728:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 2936us (3190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185119.067887:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:2.0:1784185119.074627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185119.074871:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321856 00000100:00100000:3.0:1784185119.074882:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321856 00000100:00100000:3.0:1784185119.074952:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1784185119.074962:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13843:x1870853239321856:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784185119.074988:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185119.075020:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b139b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de962683818728c expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185119.075048:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b139b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818728c expref: 12 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185119.075059:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164a600/0x63160f6fbe8b139b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818728c expref: 12 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185119.075069:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a600, rc 0) 00000100:00100000:3.0:1784185119.075141:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13843:x1870853239321856:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 180us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185119.075148:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:2.0:1784185119.096028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185119.096151:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239321984 00000100:00100000:1.0:1784185119.096163:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239321984 00000100:00100000:1.0:1784185119.096267:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:1.0:1784185119.096278:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13843:x1870853239321984:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784185119.096307:0:14123:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784185119.096384:0:14123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784185119.096389:0:14123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784185119.096392:0:14123:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784185119.096394:0:14123:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1784185119.102689:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13843:x1870853239321984:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 6399us (6655us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.102705:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:2.0:1784185119.113562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185119.113825:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239322112 00000100:00100000:0.0:1784185119.113844:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239322112 00000100:00100000:0.0:1784185119.113902:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:0.0:1784185119.113922:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13843:x1870853239322112:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784185119.113939:0:14121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185119.113960:0:14121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de9626838187293 expref: -99 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185119.114026:0:14121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 13 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185119.114040:0:14121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 13 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185119.114064:0:14121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784185119.114128:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13843:x1870853239322112:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 208us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.114135:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:2.0:1784185119.127376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185119.127467:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239322240 00000100:00100000:0.0:1784185119.127477:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239322240 00000100:00100000:0.0:1784185119.127535:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:0.0:1784185119.127546:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f8c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13843:x1870853239322240:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784185119.128209:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f8c6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13843:x1870853239322240:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 661us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.128219:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:0.0:1784185119.131507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185119.134541:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239322368 00000100:00100000:3.0:1784185119.134555:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239322368 00000100:00100000:2.0:1784185119.139581:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:2.0:1784185119.139596:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13843:x1870853239322368:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784185119.140108:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13843:x1870853239322368:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 513us (8807us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185119.140118:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:2.0:1784185119.150104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185119.150278:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239322496 00000100:00100000:0.0:1784185119.150289:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239322496 00000100:00100000:0.0:1784185119.150385:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:0.0:1784185119.150397:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13852:x1870853239322496:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784185119.150675:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13852:x1870853239322496:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 280us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.150684:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:0.0:1784185119.172663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185119.172770:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239322624 00000100:00100000:2.0:1784185119.172782:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239322624 00000100:00100000:2.0:1784185119.172884:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:2.0:1784185119.172894:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13852:x1870853239322624:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784185119.174537:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13852:x1870853239322624:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 1635us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185119.174567:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:1.0:1784185119.184216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185119.184690:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239322752 00000100:00100000:2.0:1784185119.184702:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239322752 00000100:00100000:2.0:1784185119.184813:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1784185119.184821:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1870853239322752:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784185119.184850:0:14129:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4e95cba2-b62d-4560-961a-ec21662cdd89@192.168.201.29@tcp t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:2.0:1784185119.184908:0:14129:0:(genops.c:1406:class_connect()) connect: client 4e95cba2-b62d-4560-961a-ec21662cdd89, cookie 0x63160f6fbe8b13a9 00000004:00100000:2.0:1784185119.184941:0:14129:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784185119.185582:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b5e82dfe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784185119.185684:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2352:x1870853239322752:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 861us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185119.185693:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1784185119.195838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185119.199752:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185119.204355:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323008 00000100:00100000:0.0:1784185119.204374:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323008 00000100:00100000:0.0:1784185119.204494:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1784185119.204506:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+6:13843:x1870853239323008:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784185119.204583:0:14128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784185119.204665:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+6:13843:x1870853239323008:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 161us (8837us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.204672:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00080000:0.0:1784185119.204703:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185119.205648:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239322880 00000100:00100000:0.0:1784185119.205658:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239322880 00000100:00100000:0.0:1784185119.205705:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1784185119.205714:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+6:0:x1870853239322880:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784185119.205734:0:14128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784185119.205791:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+6:0:x1870853239322880:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 78us (6048us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.205797:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1784185119.206854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185119.207792:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323136 00000100:00100000:2.0:1784185119.207802:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323136 00000100:00100000:2.0:1784185119.207857:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1784185119.207865:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:13843:x1870853239323136:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784185119.208025:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:13843:x1870853239323136:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 160us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185119.208033:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1784185119.213143:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185119.213186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185119.213247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185119.213565:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323264 00000100:00100000:0.0:1784185119.213576:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323264 00000100:00100000:0.0:1784185119.213628:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323392 00000100:00100000:0.0:1784185119.213631:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323392 00000100:00100000:0.0:1784185119.213646:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1784185119.213654:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239323264:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784185119.213689:0:14764:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4e95cba2-b62d-4560-961a-ec21662cdd89@192.168.201.29@tcp t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:0.0:1784185119.213722:0:14764:0:(genops.c:1406:class_connect()) connect: client 4e95cba2-b62d-4560-961a-ec21662cdd89, cookie 0x63160f6fbe8b13b0 00002000:00100000:0.0:1784185119.213738:0:14764:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4e95cba2-b62d-4560-961a-ec21662cdd89/ffff9b5fb6fd6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784185119.213749:0:14764:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784185119.213862:0:14764:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784185119.213893:0:14764:0:(import.c:65:import_set_state_nolock()) ffff9b5fb6fd4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784185119.214015:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2352:x1870853239323264:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 360us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.214023:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1784185119.214040:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1784185119.214045:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1870853239323392:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784185119.214060:0:14764:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4e95cba2-b62d-4560-961a-ec21662cdd89@192.168.201.29@tcp t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:0.0:1784185119.214076:0:14764:0:(genops.c:1406:class_connect()) connect: client 4e95cba2-b62d-4560-961a-ec21662cdd89, cookie 0x63160f6fbe8b13b7 00002000:00100000:0.0:1784185119.214081:0:14764:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4e95cba2-b62d-4560-961a-ec21662cdd89/ffff9b5fb6fd7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784185119.214086:0:14764:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784185119.214269:0:14764:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784185119.214283:0:14764:0:(import.c:65:import_set_state_nolock()) ffff9b5fb6fd2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784185119.214324:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2352:x1870853239323392:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 262us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185119.214370:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1784185119.215191:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323520 00000100:00100000:2.0:1784185119.215199:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323520 00000100:00100000:2.0:1784185119.215243:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1784185119.215252:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:13843:x1870853239323520:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784185119.216038:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1784185119.216190:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:13843:x1870853239323520:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 936us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185119.216198:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1784185119.386219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185119.386494:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323648 00000100:00100000:2.0:1784185119.386505:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323648 00000100:00100000:2.0:1784185119.386581:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1784185119.386592:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:13873:x1870853239323648:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:2.0:1784185119.386613:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185119.386634:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b13be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872bd expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185119.386702:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185119.386716:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185119.386729:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185119.387047:0:14129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784185119.387052:0:14129:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185119.387131:0:14129:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185119.387153:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b13be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 8 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185119.387165:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 7 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185119.387179:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:2.0:1784185119.387181:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784185119.387183:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970a00, rc 0) 00000100:00100000:2.0:1784185119.387239:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+7:13873:x1870853239323648:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 649us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185119.387247:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:1.0:1784185119.501601:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784185119.507718:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4e95cba2-b62d-4560-961a-ec21662cdd89 00000001:00100000:0.0:1784185119.507742:0:6613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 111c6c5d-699b-4985-bb82-f380714e1544 00000100:00100000:3.0:1784185120.458893:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784185120.458925:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265529216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784185120.459032:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185120.459162:0:14767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529216 00000100:00100000:0.0:1784185120.459173:0:14767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529216 00000100:00100000:0.0:1784185120.459281:0:14767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784185120.459295:0:14767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265529216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784185120.459375:0:14767:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185120.459443:0:14767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265529216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185120.459451:0:14767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1784185120.459823:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784185120.459880:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265529216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784185120.524092:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784185121.547319:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784185121.600226:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4e95cba2-b62d-4560-961a-ec21662cdd89 00000001:00100000:3.0:1784185121.600318:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 111c6c5d-699b-4985-bb82-f380714e1544 00000100:00100000:2.0:1784185122.514072:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265529728:0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514180:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185122.514271:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784185122.514276:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265529600:0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514296:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185122.514313:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265530112:0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514366:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185122.514400:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529728 00000100:00100000:2.0:1784185122.514411:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529728 00000100:00100000:2.0:1784185122.514478:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529600 00000100:00100000:2.0:1784185122.514481:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529600 00000100:00100000:2.0:1784185122.514499:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784185122.514508:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265529728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514566:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265529728:12345-0@lo:400:kworker.0 Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185122.514573:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784185122.514592:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784185122.514597:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265529600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514639:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265529600:12345-0@lo:400:kworker.0 Request processed in 42us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185122.514644:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784185122.514661:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265530112 00000100:00100000:2.0:1784185122.514664:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265530112 00000100:00100000:2.0:1784185122.514822:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784185122.514829:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265530112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514861:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1870853265530112:12345-0@lo:400:kworker.0 Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185122.514867:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1784185122.514881:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784185122.514886:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784185122.514889:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784185122.514936:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265529600:0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514949:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1870853265530112:0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.514958:0:3316:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784185122.514976:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265529728:0@lo:400:kworker.0 00000100:00100000:3.0:1784185122.515304:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265529472:0@lo:400:kworker.0 00000100:00100000:3.0:1784185122.515372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185122.515403:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265529984:0@lo:400:kworker.0 00000100:00100000:3.0:1784185122.515424:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185122.515441:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784185122.515446:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265529344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784185122.515465:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185122.515483:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265529856:0@lo:400:kworker.0 00000100:00100000:3.0:1784185122.515499:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185122.515523:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529984 00000100:00100000:3.0:1784185122.515527:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529984 00000100:00100000:3.0:1784185122.515552:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529856 00000100:00100000:3.0:1784185122.515554:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529856 00000100:00100000:3.0:1784185122.515567:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784185122.515572:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265529984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185122.515602:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1870853265529984:12345-0@lo:400:kworker.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185122.515608:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784185122.515623:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784185122.515628:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265529856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185122.515647:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1870853265529856:12345-0@lo:400:kworker.0 Request processed in 19us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185122.515653:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784185122.515674:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1870853265529856:0@lo:400:kworker.0 00000100:00100000:3.0:1784185122.515985:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1870853265529984:0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.516830:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529472 00000100:00100000:2.0:1784185122.516840:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529472 00000100:00100000:2.0:1784185122.516888:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784185122.516896:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265529472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185122.516996:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265529472:12345-0@lo:400:kworker.0 Request processed in 101us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185122.517127:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784185122.517186:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265529472:0@lo:400:kworker.0 00000100:00080000:2.0:1784185122.517227:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185122.519839:0:14767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265529344 00000100:00100000:0.0:1784185122.519868:0:14767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265529344 00000100:00100000:0.0:1784185122.519949:0:14767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784185122.519963:0:14767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265529344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784185122.522567:0:14767:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185122.522729:0:14767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265529344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2764us (7256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185122.522741:0:14767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784185122.522848:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265529344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784185122.572998:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784185122.606853:0:15986:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1784185122.619159:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4e95cba2-b62d-4560-961a-ec21662cdd89 00000040:00080000:1.0:1784185122.829590:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784185123.601308:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185124.441599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185124.441653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185124.441684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185124.441702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185124.441731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185124.441751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185124.441804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185124.441835:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324032 00000100:00100000:3.0:1784185124.441847:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324032 00000100:00100000:3.0:1784185124.441927:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324544 00000100:00100000:3.0:1784185124.441931:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324544 00000100:00100000:3.0:1784185124.441947:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324160 00000100:00100000:3.0:1784185124.441950:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324160 00000100:00100000:3.0:1784185124.441962:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324416 00000100:00100000:3.0:1784185124.441964:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324416 00000100:00100000:3.0:1784185124.441981:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1784185124.441993:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239324032:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185124.442090:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239324032:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 99us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185124.442098:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1784185124.442116:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1784185124.442122:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239324544:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185124.442148:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239324544:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185124.442155:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1784185124.442180:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1784185124.442186:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239324160:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185124.442914:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239324160:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 724us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185124.442923:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1784185124.442943:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784185124.442949:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239324416:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185124.442972:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239324416:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185124.442978:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784185124.443003:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324288 00000100:00100000:3.0:1784185124.443009:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324288 00000100:00100000:3.0:1784185124.443051:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323904 00000100:00100000:3.0:1784185124.443054:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323904 00000100:00100000:3.0:1784185124.443076:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1784185124.443082:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2353:x1870853239324288:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185124.443113:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2353:x1870853239324288:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185124.443120:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1784185124.443131:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1784185124.443137:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+6:2353:x1870853239323904:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185124.443163:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+6:2353:x1870853239323904:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185124.443169:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1784185124.443244:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239323776 00000100:00100000:0.0:1784185124.443249:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239323776 00000100:00100000:0.0:1784185124.443285:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:0.0:1784185124.443293:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2353:x1870853239323776:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185124.443322:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2353:x1870853239323776:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185124.443328:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00080000:3.0:1784185124.443927:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784185124.443935:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784185124.443937:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784185124.619260:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185125.581062:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784185125.581095:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265530240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784185125.581206:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185125.581524:0:14767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265530240 00000100:00100000:0.0:1784185125.581535:0:14767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265530240 00000100:00100000:0.0:1784185125.581623:0:14767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784185125.581636:0:14767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265530240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784185125.581686:0:14767:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784185125.581750:0:14767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265530240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185125.581758:0:14767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784185125.581820:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265530240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784185125.581896:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784185125.648263:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784185126.518415:0:16136:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe26ab1390 20000000:00000080:2.0:1784185126.518433:0:16136:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b5e82dd9800 uarg=0000000000000000 20000000:01000000:2.0:1784185126.518605:0:16136:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784185126.518611:0:16136:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784185126.518616:0:16136:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784185126.519711:0:16137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1784185126.519884:0:16136:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784185126.529273:0:16136:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784185126.529307:0:16136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529327:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 18 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529818:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529840:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 18 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529849:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529870:0:16136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529877:0:16136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529918:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.529932:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 12 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.529949:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530368:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185126.530119:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 12 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.530129:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 12 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.530138:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530496:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185126.530171:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 18 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.530192:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 18 pid: 14122 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.530203:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1637800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530624:0@lo:104: 00000100:00100000:1.0:1784185126.530245:0:16136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784185126.530291:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.530298:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 18 pid: 14123 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.530307:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1635880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530752:0@lo:104: 00000100:00100000:1.0:1784185126.530327:0:16136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784185126.530369:0:16136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 18 pid: 14121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.530378:0:16136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 18 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.530387:0:16136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530880:0@lo:104: 00000100:00100000:1.0:1784185126.530613:0:16136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185126.530624:0:16136:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af300 going to sleep for 11 seconds 00000100:00100000:0.0:1784185126.531008:0:14112:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784185126.531022:0:14112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265530624 00000100:00100000:0.0:1784185126.531029:0:14112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265530624 00000100:00100000:0.0:1784185126.531068:0:14112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265530752 00000100:00100000:0.0:1784185126.531071:0:14112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265530752 00000100:00100000:0.0:1784185126.531083:0:14112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265530880 00000100:00100000:0.0:1784185126.531085:0:14112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265530880 00000100:00100000:0.0:1784185126.531098:0:14112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185126.531107:0:14112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+5:16136:x1870853265530624:12345-0@lo:104: 00010000:00010000:0.0:1784185126.531121:0:14112:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531189:0:14112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784185126.531195:0:14112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+5:16136:x1870853265530624:12345-0@lo:104: Request processed in 89us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185126.531202:0:14112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185126.531221:0:14112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784185126.531227:0:14112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+4:16136:x1870853265530752:12345-0@lo:104: 00010000:00010000:0.0:1784185126.531234:0:14112:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531269:0:14112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784185126.531274:0:14112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+4:16136:x1870853265530752:12345-0@lo:104: Request processed in 49us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185126.531280:0:14112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784185126.531295:0:14112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784185126.531301:0:14112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf430450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:16136:x1870853265530880:12345-0@lo:104: 00010000:00010000:0.0:1784185126.531308:0:14112:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531371:0:14112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784185126.531376:0:14112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf430450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+3:16136:x1870853265530880:12345-0@lo:104: Request processed in 76us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185126.531383:0:14112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1784185126.531441:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784185126.531447:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531456:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c200 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784185126.531460:0:14117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531480:0:14117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784185126.531495:0:14117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185126.531501:0:14117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784185126.531532:0:14117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531539:0:14117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784185126.531560:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531567:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f8631c200/0x63160f6fbe8b1244 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b124b expref: -99 pid: 15427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531592:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784185126.531595:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531602:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784185126.531605:0:14117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531612:0:14117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784185126.531619:0:14117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185126.531624:0:14117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784185126.531638:0:14117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531644:0:14117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784185126.531651:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531657:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8400/0x63160f6fbe8b1109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b1110 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531665:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784185126.531669:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531685:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f9896fe00 already unused, calling callback (ffffffffc1d5bc20) 10000000:00010000:0.0:1784185126.531688:0:14117:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531696:0:14117:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784185126.531703:0:14117:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784185126.531709:0:14117:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784185126.531723:0:14117:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531730:0:14117:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784185126.531744:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531752:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9b5f9896fe00/0x63160f6fbe8b10bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x63160f6fbe8b10c3 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.531766:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185126.531767:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784185126.531769:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784185126.531789:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3313:1870853265531008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784185126.531821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185126.531852:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784185126.531873:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3313:1870853265531136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784185126.531904:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185126.531932:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3315:1870853265531264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784185126.531953:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185126.531986:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531008 00000100:00100000:0.0:1784185126.531991:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531008 00010000:00010000:0.0:1784185126.532010:0:14115:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 19 pid: 14122 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185126.532026:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531136 00000100:00100000:0.0:1784185126.532028:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531136 00010000:00010000:0.0:1784185126.532038:0:14115:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 20 pid: 14123 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185126.532048:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531264 00000100:00100000:0.0:1784185126.532068:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531264 00010000:00010000:0.0:1784185126.532080:0:14115:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 21 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185126.532093:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185126.532099:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+21:3313:x1870853265531008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784185126.532108:0:14115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185126.532114:0:14115:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 21 pid: 14122 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.532123:0:14115:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 21 pid: 14122 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.532139:0:14115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185126.532167:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+21:3313:x1870853265531008:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185126.532182:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784185126.532196:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784185126.532202:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+20:3313:x1870853265531136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784185126.532210:0:14115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185126.532214:0:14115:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 20 pid: 14123 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.532222:0:14115:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 20 pid: 14123 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.532232:0:14115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185126.532255:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+20:3313:x1870853265531136:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185126.532261:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784185126.532272:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784185126.532277:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3315:x1870853265531264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784185126.532284:0:14115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185126.532288:0:14115:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 19 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.532296:0:14115:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 19 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.532306:0:14115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185126.532328:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3315:x1870853265531264:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185126.532356:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784185126.532415:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3315:1870853265531264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784185126.532449:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3313:1870853265531136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784185126.532456:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5faf054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3313:1870853265531008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784185126.533462:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f93971e00/0x63160f6fbe8b124b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b1244 expref: 18 pid: 14122 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.533646:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1637800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530624:0@lo:104: 00010000:00010000:1.0:1784185126.533661:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5fbfbd9400/0x63160f6fbe8b1110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b1109 expref: 17 pid: 14123 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.533688:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530752:0@lo:104: 00010000:00010000:1.0:1784185126.533701:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f9896f200/0x63160f6fbe8b10c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x63160f6fbe8b10bc expref: 16 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.533709:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530880:0@lo:104: 00010000:00010000:2.0:1784185126.535730:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185126.544716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185126.544742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185126.544778:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324800 00000100:00100000:3.0:1784185126.544786:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324800 00010000:00010000:3.0:1784185126.544823:0:14114:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 13 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185126.544884:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324672 00000100:00100000:3.0:1784185126.544888:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324672 00010000:00010000:3.0:1784185126.544901:0:14114:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 14 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185126.544916:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1784185126.544925:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+14:2356:x1870853239324800:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185126.544940:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185126.544946:0:14114:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 14 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.544958:0:14114:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 14 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.544979:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185126.545030:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+14:2356:x1870853239324800:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185126.545039:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1784185126.545057:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1784185126.545078:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2356:x1870853239324672:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185126.545086:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185126.545091:0:14114:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 13 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545101:0:14114:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 13 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545114:0:14114:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545124:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545140:0:14114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545148:0:14114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545155:0:14114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545163:0:14114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545169:0:14114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:3.0:1784185126.545174:0:14114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545182:0:14114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545199:0:14114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185126.545209:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185126.545230:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2356:x1870853239324672:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 152us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185126.545237:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:1.0:1784185126.545616:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631c800/0x63160f6fbe8b13a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187293 expref: 12 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.545632:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1635f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530368:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185126.545644:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5f8631ce00/0x63160f6fbe8b136a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187231 expref: 11 pid: 14121 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185126.545654:0:16136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16136:1870853265530496:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185126.545683:0:16136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.545693:0:16136:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.545700:0:16136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185126.545707:0:16136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b5fbfbd9200/0x63160f6fbe8b13cc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185126.666642:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185127.628001:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265531776:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.628080:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185127.628163:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784185127.628170:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3315:1870853265531392:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.628201:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185127.628226:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265531904:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.628246:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185127.628272:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265531520:0@lo:400:kworker.0 00000100:00100000:1.0:1784185127.628435:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531392 00000100:00100000:1.0:1784185127.628443:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531392 00000100:00100000:1.0:1784185127.628489:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784185127.628509:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3315:x1870853265531392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185127.628565:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:3315:x1870853265531392:12345-0@lo:400:kworker.0 Request processed in 57us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185127.628572:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784185127.628623:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3315:1870853265531392:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.628806:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185127.628844:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265532032:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.628868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185127.628889:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784185127.628894:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265531648:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.628912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185127.628938:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531776 00000100:00100000:2.0:1784185127.628941:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531776 00000100:00100000:2.0:1784185127.628966:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531904 00000100:00100000:2.0:1784185127.628975:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531904 00000100:00100000:2.0:1784185127.628996:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532032 00000100:00100000:2.0:1784185127.628998:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532032 00000100:00100000:2.0:1784185127.629010:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784185127.629015:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265531776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.629053:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265531776:12345-0@lo:400:kworker.0 Request processed in 38us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185127.629059:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784185127.629072:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784185127.629078:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265531904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.629115:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265531904:12345-0@lo:400:kworker.0 Request processed in 38us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185127.629122:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784185127.629133:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784185127.629139:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265532032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.629169:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1870853265532032:12345-0@lo:400:kworker.0 Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185127.629175:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784185127.629213:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1870853265532032:0@lo:400:kworker.0 00000100:00100000:3.0:1784185127.629264:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531520 00000100:00100000:3.0:1784185127.629268:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531520 00000100:00100000:3.0:1784185127.629316:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265531648 00000100:00100000:3.0:1784185127.629319:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265531648 00000100:00100000:3.0:1784185127.629358:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784185127.629366:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265531520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185127.629404:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265531520:12345-0@lo:400:kworker.0 Request processed in 39us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185127.629410:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784185127.629422:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784185127.629427:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265531648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784185127.629454:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265531648:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185127.629459:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784185127.629722:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265531648:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.629740:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265531520:0@lo:400:kworker.0 00000100:00080000:1.0:1784185127.629822:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784185127.629827:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784185127.629830:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784185127.629867:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265531904:0@lo:400:kworker.0 00000100:00100000:1.0:1784185127.629878:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265531776:0@lo:400:kworker.0 00000100:00100000:2.0:1784185127.634752:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265532160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784185127.634820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185127.634933:0:14767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532160 00000100:00100000:3.0:1784185127.634942:0:14767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532160 00000100:00100000:3.0:1784185127.635028:0:14767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784185127.635038:0:14767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265532160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784185127.635070:0:14767:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784185127.635136:0:14767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265532160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185127.635144:0:14767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784185127.641638:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265532160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784185127.691405:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784185128.331345:0:14125:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784185128.331354:0:14125:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fb6ffa000 from 10 10000000:01000000:1.0:1784185128.331361:0:14125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784185128.331415:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8800/0x63160f6fbe8b13d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.331428:0:14125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8800/0x63160f6fbe8b13d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.331439:0:14125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8800/0x63160f6fbe8b13d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185128.331465:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.331537:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185128.331583:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af900 going to sleep for 11 seconds 00000100:00100000:1.0:1784185128.331604:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532288 00000100:00100000:1.0:1784185128.331610:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532288 00000100:00100000:1.0:1784185128.331653:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784185128.331670:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+16:14125:x1870853265532288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784185128.331683:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185128.331696:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5fbfbd9800/0x63160f6fbe8b13da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b13d3 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.331720:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5fbfbd9800/0x63160f6fbe8b13da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b13d3 expref: 17 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.331730:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5fbfbd9800/0x63160f6fbe8b13da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b13d3 expref: 17 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.331739:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9800, rc 0) 00000100:00100000:1.0:1784185128.331777:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:14125:x1870853265532288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185128.331783:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784185128.331845:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784185128.331859:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8800/0x63160f6fbe8b13d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13da expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.331868:0:14125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8800/0x63160f6fbe8b13d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b13da expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185128.331917:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.331940:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185128.331953:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af900 going to sleep for 11 seconds 00000100:00100000:1.0:1784185128.331965:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532416 00000100:00100000:1.0:1784185128.331968:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532416 00000100:00100000:1.0:1784185128.331988:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784185128.332001:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:14125:x1870853265532416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.332525:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:14125:x1870853265532416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 523us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185128.332533:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784185128.332573:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.332603:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.332642:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185128.333252:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af900 going to sleep for 11 seconds 00000100:00100000:3.0:1784185128.334067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185128.334456:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532544 00000100:00100000:1.0:1784185128.334465:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532544 00000100:00100000:1.0:1784185128.334510:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239324928 00000100:00100000:1.0:1784185128.334513:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239324928 00000100:00100000:1.0:1784185128.334529:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784185128.334537:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:14125:x1870853265532544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784185128.334676:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:3.0:1784185128.334688:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+11:13728:x1870853239324928:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784185128.334699:0:14122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185128.334716:0:14122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b13e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de96268381872c4 expref: -99 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185128.334744:0:14122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b13e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872c4 expref: 12 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185128.334757:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:14125:x1870853265532544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (2111us total) trans 0 rc 0/0 00010000:00010000:3.0:1784185128.334758:0:14122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164be00/0x63160f6fbe8b13e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872c4 expref: 12 pid: 14122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185128.334774:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1784185128.334777:0:14122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164be00, rc 0) 00000100:00100000:3.0:1784185128.334833:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13728:x1870853239324928:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 138us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185128.334841:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:1.0:1784185128.334849:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784185128.336970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185128.337043:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325056 00000100:00100000:1.0:1784185128.337052:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325056 00000100:00100000:1.0:1784185128.337109:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:1.0:1784185128.337117:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13728:x1870853239325056:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.337549:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13728:x1870853239325056:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 431us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185128.337557:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 110 00000040:00080000:3.0:1784185128.339679:0:16205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784185128.340406:0:14125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784185128.340432:0:14125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784185128.340445:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8800/0x63160f6fbe8b13d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13da expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.340456:0:14125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd8800/0x63160f6fbe8b13d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13da expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784185128.340468:0:14125:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784185128.340471:0:14125:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbf93f000 from 10 10000000:01000000:1.0:1784185128.340474:0:14125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784185128.340513:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b13e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.340522:0:14125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b13e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.340532:0:14125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b13e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185128.340557:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.340621:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185128.340667:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185128.341479:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532672 00000100:00100000:3.0:1784185128.341489:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532672 00000100:00100000:3.0:1784185128.341535:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784185128.341544:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+17:14125:x1870853265532672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784185128.341560:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185128.341584:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164b200/0x63160f6fbe8b13ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b13e8 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185128.341613:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164b200/0x63160f6fbe8b13ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b13e8 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185128.341624:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164b200/0x63160f6fbe8b13ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b13e8 expref: 18 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185128.341633:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b200, rc 0) 00000100:00100000:2.0:1784185128.341691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185128.341701:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:14125:x1870853265532672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185128.341710:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784185128.341724:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325184 00000100:00100000:2.0:1784185128.341729:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325184 00000100:00100000:2.0:1784185128.341761:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:2.0:1784185128.341769:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13728:x1870853239325184:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.342043:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784185128.342060:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b13e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13ef expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.342069:0:14125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b13e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b13ef expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185128.342155:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.342190:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185128.342223:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185128.342462:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532800 00000100:00100000:3.0:1784185128.342467:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532800 00000100:00100000:3.0:1784185128.342487:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784185128.342494:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:14125:x1870853265532800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784185128.342583:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13728:x1870853239325184:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 812us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185128.342591:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:3.0:1784185128.342732:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:14125:x1870853265532800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185128.342740:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784185128.342863:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.342895:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.342928:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185128.342955:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784185128.342991:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265532928 00000100:00100000:2.0:1784185128.342994:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265532928 00000100:00100000:2.0:1784185128.343023:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784185128.343030:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:14125:x1870853265532928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784185128.343308:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:14125:x1870853265532928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185128.343314:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784185128.343407:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1636a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265532928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784185128.344928:0:16206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784185128.346295:0:14125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784185128.346328:0:14125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784185128.346369:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b13e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13ef expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185128.346382:0:14125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5fbfbd9e00/0x63160f6fbe8b13e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13ef expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784185128.346393:0:14125:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784185128.346396:0:14125:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b5fbf5dc000 from 10 10000000:01000000:2.0:1784185128.346399:0:14125:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784185128.346441:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970800/0x63160f6fbe8b13f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185128.346462:0:14125:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9b5f93970800/0x63160f6fbe8b13f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185128.346474:0:14125:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9b5f93970800/0x63160f6fbe8b13f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185128.346499:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265533056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784185128.346560:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185128.346611:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5fb50d9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784185128.346922:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265533056 00000100:00100000:3.0:1784185128.346931:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265533056 00000100:00100000:3.0:1784185128.347045:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784185128.347056:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+18:14125:x1870853265533056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784185128.347070:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185128.347097:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b13fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63160f6fbe8b13f6 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185128.347134:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b13fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x63160f6fbe8b13f6 expref: 19 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185128.347145:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8164b000/0x63160f6fbe8b13fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x63160f6fbe8b13f6 expref: 19 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185128.347155:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b000, rc 0) 00000100:00100000:3.0:1784185128.347208:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265533056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185128.347215:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784185128.347922:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265533056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784185128.347942:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9b5f93970800/0x63160f6fbe8b13f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13fd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185128.347953:0:14125:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9b5f93970800/0x63160f6fbe8b13f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x63160f6fbe8b13fd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185128.348010:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784185128.348040:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185128.348069:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f85e1df00 going to sleep for 11 seconds 00000100:00100000:2.0:1784185128.348309:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265533184 00000100:00100000:2.0:1784185128.348314:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265533184 00000100:00100000:2.0:1784185128.348374:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784185128.348382:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265533184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784185128.348617:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265533184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185128.348625:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784185128.350853:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784185128.350924:0:14125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265533312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784185128.350996:0:14125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784185128.351039:0:14125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f85e1df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784185128.351219:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265533312 00000100:00100000:3.0:1784185128.351226:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265533312 00000100:00100000:3.0:1784185128.351277:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784185128.351294:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265533312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784185128.351535:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:14125:x1870853265533312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185128.351543:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784185128.351773:0:14125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:14125:1870853265533312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784185128.353250:0:16207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:3.0:1784185128.359409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185128.359593:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325312 00000100:00100000:0.0:1784185128.359604:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325312 00000100:00100000:0.0:1784185128.359657:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:0.0:1784185128.359666:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+12:13728:x1870853239325312:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784185128.359683:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185128.359700:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8de96268381872cb expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185128.359739:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872cb expref: 13 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185128.359749:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b5f8631d000/0x63160f6fbe8b1404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872cb expref: 13 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185128.359758:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631d000, rc 0) 00000100:00100000:0.0:1784185128.359814:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13728:x1870853239325312:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 148us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185128.359820:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000020:01000000:1.0:1784185128.362662:0:14125:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784185128.362701:0:14125:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784185128.362713:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9b5f93970800/0x63160f6fbe8b13f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13fd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185128.362726:0:14125:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9b5f93970800/0x63160f6fbe8b13f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x63160f6fbe8b13fd expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185128.364619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185128.364679:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325440 00000100:00100000:1.0:1784185128.364688:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325440 00000100:00100000:1.0:1784185128.364734:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:1.0:1784185128.364742:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13728:x1870853239325440:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784185128.365191:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13728:x1870853239325440:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 448us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185128.365210:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:0.0:1784185128.373640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185128.373775:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325568 00000100:00100000:3.0:1784185128.373784:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325568 00000100:00100000:3.0:1784185128.373844:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1784185128.373854:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13728:x1870853239325568:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784185128.374093:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:13728:x1870853239325568:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 232us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185128.374102:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00010000:00010000:0.0:1784185128.715443:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185129.554189:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185129.554227:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185129.554253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185129.554276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185129.554298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185129.554325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185129.554404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185129.554434:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325952 00000100:00100000:1.0:1784185129.554442:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325952 00000100:00100000:1.0:1784185129.554498:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239326464 00000100:00100000:1.0:1784185129.554501:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239326464 00000100:00100000:1.0:1784185129.554512:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239326080 00000100:00100000:1.0:1784185129.554514:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239326080 00000100:00100000:2.0:1784185129.554783:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239326208 00000100:00100000:2.0:1784185129.554788:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239326208 00000100:00100000:2.0:1784185129.554826:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325824 00000100:00100000:2.0:1784185129.554829:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325824 00000100:00100000:2.0:1784185129.554849:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1784185129.554857:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2355:x1870853239326208:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185129.554920:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2355:x1870853239326208:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 64us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185129.554927:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1784185129.554944:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1784185129.554961:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+6:2355:x1870853239325824:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185129.554983:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+6:2355:x1870853239325824:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185129.554989:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1784185129.555025:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239326336 00000100:00100000:2.0:1784185129.555028:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239326336 00000100:00100000:2.0:1784185129.555044:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1784185129.555049:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:111c6c5d-699b-4985-bb82-f380714e1544+5:2355:x1870853239325952:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185129.555071:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:111c6c5d-699b-4985-bb82-f380714e1544+5:2355:x1870853239325952:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185129.555077:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1784185129.555087:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1784185129.555123:0:14764:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784185129.555130:0:14764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1784185129.555145:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784185129.555149:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784185129.555191:0:14763:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784185129.555205:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784185129.555212:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2355:x1870853239326336:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185129.555236:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2355:x1870853239326336:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185129.555243:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1784185129.555252:0:14763:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784185129.555257:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1784185129.557281:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239325696 00000100:00100000:0.0:1784185129.557294:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239325696 00000100:00100000:0.0:1784185129.557389:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:0.0:1784185129.557399:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2355:x1870853239325696:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185129.557473:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2355:x1870853239325696:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 75us (3293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185129.557482:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:2.0:1784185129.562822:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2355:x1870853239326464:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185129.562937:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2355:x1870853239326464:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 7841us (8657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185129.562948:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00080000:1.0:1784185129.564187:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784185129.564537:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2355:x1870853239326080:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1784185129.565030:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2355:x1870853239326080:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 9756us (10693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185129.565042:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:2.0:1784185129.739244:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185130.646585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185130.650450:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239326592 00000100:00100000:2.0:1784185130.650468:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239326592 00000100:00100000:2.0:1784185130.650555:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1784185130.650565:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+6:14385:x1870853239326592:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784185130.650585:0:15288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185130.650608:0:15288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970200/0x63160f6fbe8b140b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872d2 expref: -99 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.650695:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.650708:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.650720:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.650736:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.650742:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.650748:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.651710:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970600/0x63160f6fbe8b1420 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.651724:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970600/0x63160f6fbe8b1420 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.651733:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970600/0x63160f6fbe8b1420 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185130.651912:0:15288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784185130.651916:0:15288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185130.652003:0:15288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970600/0x63160f6fbe8b1420 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652025:0:15288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652032:0:15288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652039:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652044:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.652048:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652055:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652067:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:2.0:1784185130.652071:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.652074:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652080:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652092:0:15288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652098:0:15288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652104:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652115:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.652118:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652123:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652131:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b5f8545e000) 00010000:00010000:2.0:1784185130.652134:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.652136:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652142:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1419 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652180:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970200/0x63160f6fbe8b140b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872d2 expref: 8 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652193:0:15288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970600/0x63160f6fbe8b1420 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872d2 expref: 7 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.652200:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b5f8545ec00) 00010000:00010000:2.0:1784185130.652203:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784185130.652205:0:15288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970600, rc 0) 00000100:00100000:2.0:1784185130.654186:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+7:14385:x1870853239326592:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 3612us (7600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185130.654200:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1784185130.682374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185130.682511:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239326848 00000100:00100000:0.0:1784185130.682522:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239326848 00000100:00100000:0.0:1784185130.682590:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1784185130.682602:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:14385:x1870853239326848:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784185130.682624:0:14128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185130.682657:0:14128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b1427 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872d9 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.682738:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.682753:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.682763:0:14128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.682985:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.682994:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.683001:0:14128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684237:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c200/0x63160f6fbe8b143c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684353:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c200/0x63160f6fbe8b143c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684365:0:14128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c200/0x63160f6fbe8b143c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784185130.684377:0:14128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1784185130.684732:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684751:0:14128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684758:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684764:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185130.684768:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684776:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684800:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b5f8545ec00) 00010000:00010000:0.0:1784185130.684803:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185130.684807:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684813:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b142e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684826:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684832:0:14128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684838:0:14128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684842:0:14128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631da00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:0.0:1784185130.684852:0:14128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684858:0:14128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684867:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b5f87fe3000) 00010000:00010000:0.0:1784185130.684869:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185130.684872:0:14128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.684878:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b1435 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.685250:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631ce00/0x63160f6fbe8b1427 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872d9 expref: 10 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.686754:0:14128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c200/0x63160f6fbe8b143c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872d9 expref: 9 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.686765:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f87fe3800) 00010000:00010000:0.0:1784185130.686768:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784185130.686771:0:14128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c200, rc 0) 00000100:00100000:0.0:1784185130.686884:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+9:14385:x1870853239326848:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 4284us (4629us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784185130.686893:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1784185130.702030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185130.702140:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239326976 00000100:00100000:1.0:1784185130.702150:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239326976 00000100:00100000:1.0:1784185130.702220:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1784185130.702231:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+9:14385:x1870853239326976:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784185130.702374:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+9:14385:x1870853239326976:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 144us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185130.702382:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1784185130.702866:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784185130.702883:0:3316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265533440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784185130.702929:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185130.703152:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265533440 00000100:00100000:2.0:1784185130.703158:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265533440 00000100:00100000:2.0:1784185130.703222:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784185130.703230:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265533440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784185130.703407:0:14766:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784185130.703470:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1870853265533440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185130.703476:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784185130.703558:0:3316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1870853265533440:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784185130.704676:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784185130.721723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185130.721927:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239327104 00000100:00100000:2.0:1784185130.721936:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239327104 00000100:00100000:2.0:1784185130.721985:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1784185130.721994:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+9:14391:x1870853239327104:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185130.722015:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185130.722036:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970200/0x63160f6fbe8b144a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872e0 expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722098:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722114:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722124:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722138:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722145:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722421:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722667:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722677:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722684:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722690:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.722695:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722702:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722716:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:2.0:1784185130.722719:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.722724:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722731:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b1451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722744:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722751:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722763:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722768:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.722772:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722778:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722799:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b5f8545e000) 00010000:00010000:2.0:1784185130.722802:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.722805:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722810:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b1458 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722844:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970200/0x63160f6fbe8b144a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872e0 expref: 10 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722854:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:2.0:1784185130.722856:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.722860:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970200/0x63160f6fbe8b144a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872e0 expref: 10 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.722868:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970200, rc 0) 00000100:00100000:2.0:1784185130.722921:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+9:14391:x1870853239327104:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 927us (1207us total) trans 0 rc 301/301 00000100:00100000:2.0:1784185130.722938:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1784185130.739037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185130.739195:0:14137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239327232 00000100:00100000:2.0:1784185130.739206:0:14137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239327232 00000100:00100000:2.0:1784185130.739271:0:14137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1784185130.739282:0:14137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:111c6c5d-699b-4985-bb82-f380714e1544+9:14391:x1870853239327232:12345-192.168.201.29@tcp:700:lfs.0 00000100:00100000:2.0:1784185130.739570:0:14137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:111c6c5d-699b-4985-bb82-f380714e1544+9:14391:x1870853239327232:12345-192.168.201.29@tcp:700:lfs.0 Request processed in 288us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185130.739579:0:14137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1784185130.745095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185130.745305:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239327488 00000100:00100000:1.0:1784185130.745316:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239327488 00000100:00100000:1.0:1784185130.745412:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1784185130.745423:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+9:14391:x1870853239327488:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1784185130.745490:0:14130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784185130.745528:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971800/0x63160f6fbe8b138d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818725b expref: 9 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.745550:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:1.0:1784185130.745555:0:14130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784185130.745864:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.745878:0:14130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 5 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.745888:0:14130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.745924:0:14130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 5 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.745940:0:14130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 5 pid: 14129 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185130.745955:0:14130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14130:1870853265533568:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784185130.746059:0:14130:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902afb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784185130.751426:0:14130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14130:1870853265533568:192.168.201.29@tcp:104: 00010000:00010000:0.0:1784185130.751464:0:14130:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185130.753483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185130.753606:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239327616 00000100:00100000:3.0:1784185130.753616:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239327616 00010000:00010000:3.0:1784185130.753655:0:14114:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 6 pid: 14129 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185130.753697:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1784185130.753707:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2355:x1870853239327616:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185130.753722:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185130.753778:0:14114:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 6 pid: 14129 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.753840:0:14114:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 6 pid: 14129 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.753865:0:14114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970a00/0x63160f6fbe8b13c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de96268381872bd expref: 6 pid: 14129 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.753881:0:14114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:3.0:1784185130.753887:0:14114:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.753896:0:14114:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.753903:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.753971:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185130.754026:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2355:x1870853239327616:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 320us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185130.754034:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00010000:00010000:1.0:1784185130.759940:0:14130:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.759979:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.760012:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.760026:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.760038:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.763522:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:1.0:1784185130.768926:0:14130:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784185130.768946:0:14130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.768957:0:14130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.768964:0:14130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.768969:0:14130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185130.768974:0:14130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.768981:0:14130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.768999:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f8545e700) 00010000:00010000:1.0:1784185130.769002:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185130.769014:0:14130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.769020:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b145f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784185130.769043:0:14130:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d80fb58 reply state 00000000a5fe9ecb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185130.769052:0:14130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784185130.769920:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+10:14391:x1870853239327488:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 23737us (24074us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784185130.769933:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:2.0:1784185130.771531:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.771546:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.771554:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.771561:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8a00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.771566:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.771574:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.771592:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b5f8c4f5700) 00010000:00010000:2.0:1784185130.771595:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.771601:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.771623:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b1466 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185130.858224:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185130.858371:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239327744 00000100:00100000:0.0:1784185130.858386:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239327744 00000100:00100000:0.0:1784185130.858463:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1784185130.858474:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+9:14399:x1870853239327744:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:0.0:1784185130.858499:0:14128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185130.858521:0:14128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c400/0x63160f6fbe8b146d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872e7 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.858592:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b1474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.858607:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b1474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.858620:0:14128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b1474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784185130.858679:0:14128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784185130.858683:0:14128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784185130.858721:0:14128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b1474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.858746:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c400/0x63160f6fbe8b146d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872e7 expref: 11 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.858791:0:14128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631de00/0x63160f6fbe8b1474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872e7 expref: 10 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185130.858800:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:0.0:1784185130.858803:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784185130.858806:0:14128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631de00, rc 0) 00000100:00100000:0.0:1784185130.858878:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+10:14399:x1870853239327744:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 406us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185130.858886:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1784185130.905718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185130.906053:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239327872 00000100:00100000:3.0:1784185130.906068:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239327872 00000100:00100000:3.0:1784185130.906153:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1784185130.906166:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+5:14400:x1870853239327872:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784185130.906193:0:15288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185130.906223:0:15288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b147b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872ee expref: -99 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.906364:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b400/0x63160f6fbe8b1482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.906378:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b400/0x63160f6fbe8b1482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.906389:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b400/0x63160f6fbe8b1482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185130.906728:0:15288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784185130.906734:0:15288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185130.906764:0:15288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b400/0x63160f6fbe8b1482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.906803:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b147b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872ee expref: 7 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.906827:0:15288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b400/0x63160f6fbe8b1482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872ee expref: 6 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.906837:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:3.0:1784185130.906840:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784185130.906845:0:15288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b400, rc 0) 00000100:00100000:3.0:1784185130.907778:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+6:14400:x1870853239327872:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1606us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185130.907800:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1784185130.911149:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185130.911647:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239328000 00000100:00100000:3.0:1784185130.911662:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239328000 00000100:00100000:3.0:1784185130.911760:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1784185130.911773:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+6:14400:x1870853239328000:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784185130.911812:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185130.911842:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872f5 expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.911949:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.911964:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.911977:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.911997:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.912004:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.912011:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.924453:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a800/0x63160f6fbe8b149e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.924478:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a800/0x63160f6fbe8b149e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.924493:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a800/0x63160f6fbe8b149e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185130.924871:0:14129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1784185130.924876:0:14129:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185130.925211:0:14129:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a800/0x63160f6fbe8b149e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.925228:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.925234:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930353:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930362:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164ba00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185130.930368:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930377:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930398:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:3.0:1784185130.930401:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185130.930405:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930412:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b1490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930435:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930462:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930469:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930475:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164a200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185130.930478:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930484:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930492:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b5fa00c7f00) 00010000:00010000:3.0:1784185130.930494:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185130.930496:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930502:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1497 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930571:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872f5 expref: 8 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930587:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a800/0x63160f6fbe8b149e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872f5 expref: 7 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185130.930595:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5fa00c7000) 00010000:00010000:3.0:1784185130.930598:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784185130.930607:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a800, rc 0) 00000100:00100000:3.0:1784185130.930687:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+7:14400:x1870853239328000:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 18916us (19550us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185130.930697:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1784185130.939560:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185130.939736:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239328256 00000100:00100000:1.0:1784185130.939749:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239328256 00000100:00100000:1.0:1784185130.939848:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1784185130.939860:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+7:14400:x1870853239328256:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1784185130.939891:0:14130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185130.939923:0:14130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b14a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de96268381872fc expref: -99 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185130.940086:0:14130:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784185130.940251:0:14130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b14a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872fc expref: 9 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.940269:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:1.0:1784185130.940272:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784185130.940279:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b14a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872fc expref: 9 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185130.940321:0:14130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9400, rc 0) 00000100:00100000:1.0:1784185130.940465:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+8:14400:x1870853239328256:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 607us (918us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1784185130.940475:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1784185130.947813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185130.947961:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239328512 00000100:00100000:2.0:1784185130.947982:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239328512 00000100:00100000:2.0:1784185130.948064:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1784185130.948077:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+8:14400:x1870853239328512:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:2.0:1784185130.948154:0:14128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185130.948194:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a800/0x63160f6fbe8b149e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de96268381872f5 expref: 8 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.948219:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5fa00c7000) 00010000:00010000:2.0:1784185130.948231:0:14128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784185130.948262:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.948278:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.948289:0:14128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784185130.948751:0:14128:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055f83984 reply state 00000000172de79e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185130.948766:0:14128:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784185130.948790:0:14128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1784185130.949389:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+9:14400:x1870853239328512:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 1310us (1586us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784185130.950174:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1784185130.961305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:2.0:1784185130.961448:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.961461:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.961468:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.961481:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.961486:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.961495:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.961518:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5f8545e000) 00010000:00010000:2.0:1784185130.961522:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1784185130.961527:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.961535:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185130.961756:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239328768 00000100:00100000:1.0:1784185130.961769:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239328768 00000100:00100000:1.0:1784185130.961846:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1784185130.961855:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+8:14400:x1870853239328768:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1784185130.962195:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+9:14400:x1870853239328768:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 340us (902us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784185130.962202:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1784185130.966045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185130.966150:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239329024 00000100:00100000:2.0:1784185130.966162:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239329024 00000100:00100000:2.0:1784185130.966224:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1784185130.966232:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+9:14400:x1870853239329024:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185130.966261:0:14130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185130.966302:0:14130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187303 expref: -99 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966429:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966443:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966454:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966466:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966470:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966480:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185130.966641:0:14130:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784185130.966756:0:14130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966765:0:14130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966772:0:14130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966789:0:14130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.966794:0:14130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966811:0:14130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966826:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:2.0:1784185130.966830:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.966835:0:14130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966840:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966853:0:14130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966856:0:14130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966860:0:14130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966863:0:14130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971e00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185130.966865:0:14130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966868:0:14130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966872:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b5f8545e500) 00010000:00010000:2.0:1784185130.966873:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185130.966875:0:14130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966886:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966929:0:14130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187303 expref: 11 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966939:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:2.0:1784185130.966942:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784185130.966945:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187303 expref: 11 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.966955:0:14130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970400, rc 0) 00000100:00100000:2.0:1784185130.967092:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+10:14400:x1870853239329024:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 860us (1060us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1784185130.967099:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1784185130.973800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185130.973978:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239329152 00000100:00100000:2.0:1784185130.973994:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239329152 00000100:00100000:2.0:1784185130.974119:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1784185130.974133:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+10:14400:x1870853239329152:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185130.974166:0:14128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185130.974197:0:14128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818730a expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.974319:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.974639:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.974675:0:14128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185130.974749:0:14128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784185130.974754:0:14128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185130.974791:0:14128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.974825:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 12 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.974848:0:14128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 11 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185130.974859:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5f8545e000) 00010000:00010000:2.0:1784185130.974862:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784185130.974867:0:14128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93970c00, rc 0) 00000100:00100000:2.0:1784185130.975079:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+11:14400:x1870853239329152:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 948us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185130.975088:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1784185130.988362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185130.988448:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239329280 00000100:00100000:2.0:1784185130.988460:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239329280 00000100:00100000:2.0:1784185130.988553:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1784185130.988563:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+11:14400:x1870853239329280:12345-192.168.201.29@tcp:37:lfs.0 00000100:00100000:3.0:1784185130.993808:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+11:14400:x1870853239329280:12345-192.168.201.29@tcp:37:lfs.0 Request processed in 5219us (5452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185130.993835:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1784185131.004196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.004426:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239329536 00000100:00100000:3.0:1784185131.004441:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239329536 00000100:00100000:3.0:1784185131.004547:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00080000:1.0:1784185131.004767:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185131.004823:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf8e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+11:14400:x1870853239329536:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1784185131.005701:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf8e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e95cba2-b62d-4560-961a-ec21662cdd89+12:14400:x1870853239329536:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 876us (1512us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1784185131.005715:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000040:00080000:2.0:1784185131.019193:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784185131.116458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185131.116982:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239329664 00000100:00100000:2.0:1784185131.116996:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239329664 00000100:00080000:1.0:1784185131.117270:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784185131.117321:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1784185131.117361:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+10:14406:x1870853239329664:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1784185131.117389:0:14130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185131.117428:0:14130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187311 expref: -99 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117510:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117527:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117541:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117558:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117565:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117572:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117720:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117727:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117734:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185131.117793:0:14130:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784185131.117797:0:14130:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185131.117843:0:14130:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117859:0:14130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117867:0:14130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117874:0:14130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117880:0:14130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185131.117886:0:14130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117894:0:14130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117909:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:2.0:1784185131.117912:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185131.117917:0:14130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117924:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970400/0x63160f6fbe8b14eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117940:0:14130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117956:0:14130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117962:0:14130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117967:0:14130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971e00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185131.117971:0:14130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117977:0:14130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117985:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b5f8545e500) 00010000:00010000:2.0:1784185131.117987:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185131.117990:0:14130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.117997:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b14f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.118051:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b14e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187311 expref: 12 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.118066:0:14130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971200/0x63160f6fbe8b14f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187311 expref: 11 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.118073:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5f8545e000) 00010000:00010000:2.0:1784185131.118076:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784185131.118085:0:14130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971200, rc 0) 00000100:00100000:2.0:1784185131.118174:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+11:14406:x1870853239329664:12345-192.168.201.29@tcp:101:bash.0 Request processed in 843us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185131.118183:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1784185131.123006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.123153:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239329920 00000100:00100000:3.0:1784185131.123166:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239329920 00000100:00100000:3.0:1784185131.123239:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1784185131.123251:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+11:14406:x1870853239329920:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784185131.123278:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185131.123306:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1500 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187318 expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.123522:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.123541:0:14129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 11 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.123573:0:14129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.123616:0:14129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 11 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.123631:0:14129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 11 pid: 14128 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.123648:0:14129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265533696:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784185131.123757:0:14129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87c9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784185131.129088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185131.129222:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239330048 00000100:00100000:2.0:1784185131.129235:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239330048 00010000:00010000:2.0:1784185131.129289:0:14115:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 12 pid: 14128 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185131.129361:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1784185131.129373:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+12:2356:x1870853239330048:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784185131.129405:0:14115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185131.129413:0:14115:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 12 pid: 14128 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.129428:0:14115:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 12 pid: 14128 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.129455:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5f8545e000) 00010000:00010000:2.0:1784185131.129462:0:14115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.129474:0:14115:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.129482:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.129527:0:14115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185131.129595:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e95cba2-b62d-4560-961a-ec21662cdd89+12:2356:x1870853239330048:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 223us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185131.129603:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00010000:00010000:3.0:1784185131.130177:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b14dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818730a expref: 11 pid: 14128 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.130200:0:14129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265533696:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784185131.130225:0:14129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.130236:0:14129:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.130242:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.130273:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.130285:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.130303:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131297:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131314:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131324:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185131.131368:0:14129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784185131.131404:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131413:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131421:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131429:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164a200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185131.131434:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131444:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131458:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5f8545e000) 00010000:00010000:3.0:1784185131.131461:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185131.131475:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131483:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b1507 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784185131.131497:0:14129:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9db7b0c reply state 000000000159653f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.131507:0:14129:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784185131.131549:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1500 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 14 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131566:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 13 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.131575:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.131578:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1784185131.131581:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b600, rc 0) 00000100:00100000:3.0:1784185131.131667:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+14:14406:x1870853239329920:12345-192.168.201.29@tcp:101:bash.0 Request processed in 8418us (8677us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1784185131.131678:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00010000:00010000:2.0:1784185131.137821:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.137845:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.137855:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.137861:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164ba00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185131.137868:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.137878:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.137902:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b5fa00c7f00) 00010000:00010000:2.0:1784185131.137906:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185131.137913:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.137920:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b150e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185131.151529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.151653:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239330176 00000100:00100000:3.0:1784185131.151666:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239330176 00000100:00100000:3.0:1784185131.151741:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1784185131.151753:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+13:14406:x1870853239330176:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1784185131.151795:0:15288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185131.151827:0:15288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1523 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818731f expref: -99 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.151946:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.151964:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.151979:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185131.152033:0:15288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784185131.152038:0:15288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185131.152063:0:15288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.152077:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.152106:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1523 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 15 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.152130:0:15288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 14 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.152140:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.152144:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185131.152148:0:15288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a200, rc 0) 00000100:00100000:3.0:1784185131.152234:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+14:14406:x1870853239330176:12345-192.168.201.29@tcp:101:bash.0 Request processed in 483us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185131.152243:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:1.0:1784185131.156975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185131.157083:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239330432 00000100:00100000:2.0:1784185131.157115:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239330432 00000100:00100000:2.0:1784185131.157186:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1784185131.157198:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+14:14406:x1870853239330432:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1784185131.158482:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+15:14406:x1870853239330432:12345-192.168.201.29@tcp:35:bash.0 Request processed in 1277us (1515us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1784185131.158496:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1784185131.281852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185131.282009:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239330688 00000100:00100000:2.0:1784185131.282022:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239330688 00000100:00100000:2.0:1784185131.282111:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1784185131.282124:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+15:14416:x1870853239330688:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1784185131.282156:0:14128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185131.282187:0:14128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b1531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187326 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784185131.283603:0:14128:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784185131.283841:0:14128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b1531 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187326 expref: 17 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.283861:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b5f87fe3000) 00010000:00010000:0.0:1784185131.283865:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784185131.283871:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971e00/0x63160f6fbe8b1531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187326 expref: 17 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.283889:0:14128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971e00, rc 0) 00000100:00100000:0.0:1784185131.284120:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+16:14416:x1870853239330688:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1997us (2283us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1784185131.284146:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:1.0:1784185131.288694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185131.289199:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239330944 00000100:00100000:0.0:1784185131.289214:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239330944 00000100:00100000:0.0:1784185131.289329:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1784185131.289379:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+16:14416:x1870853239330944:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1784185131.289960:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+17:14416:x1870853239330944:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 579us (1277us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1784185131.289971:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1784185131.336522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.336769:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239331200 00000100:00100000:3.0:1784185131.336791:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239331200 00000100:00100000:3.0:1784185131.336870:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:3.0:1784185131.336882:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+17:14419:x1870853239331200:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1784185131.336919:0:15288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185131.336948:0:15288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b153f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818732d expref: -99 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.337086:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1546 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.337104:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.337120:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185131.337133:0:15288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784185131.337307:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b153f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818732d expref: 20 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.337402:0:15288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1546 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818732d expref: 19 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.337486:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.337491:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185131.337496:0:15288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164ae00, rc 0) 00000100:00100000:3.0:1784185131.337584:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+19:14419:x1870853239331200:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 704us (1079us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1784185131.337613:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1784185131.342212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.342450:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239331328 00000100:00100000:3.0:1784185131.342465:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239331328 00000100:00100000:3.0:1784185131.342532:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:3.0:1784185131.342545:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+19:14419:x1870853239331328:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1784185131.342644:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342666:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342680:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342714:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342721:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342729:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342736:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b800 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185131.342741:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342749:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342762:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.342792:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784185131.342799:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.342806:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1554 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.342899:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+19:14419:x1870853239331328:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 357us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185131.342907:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1784185131.346886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.346978:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239331584 00000100:00100000:3.0:1784185131.346992:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239331584 00000100:00100000:3.0:1784185131.347134:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1784185131.347146:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+19:14419:x1870853239331584:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1784185131.347627:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+20:14419:x1870853239331584:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 481us (755us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1784185131.347636:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1784185131.351516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185131.351891:0:14113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239331712 00000100:00100000:0.0:1784185131.351904:0:14113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239331712 00000100:00100000:0.0:1784185131.351989:0:14113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1784185131.352002:0:14113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:111c6c5d-699b-4985-bb82-f380714e1544+20:2355:x1870853239331712:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185131.352023:0:14113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185131.352069:0:14113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1546 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818732d expref: 20 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.352097:0:14113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:0.0:1784185131.352105:0:14113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185131.352185:0:14113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:111c6c5d-699b-4985-bb82-f380714e1544+19:2355:x1870853239331712:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 185us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185131.352193:0:14113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1784185131.700720:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.701917:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239331968 00000100:00100000:3.0:1784185131.701936:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239331968 00000100:00100000:3.0:1784185131.702045:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:3.0:1784185131.702057:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+19:14450:x1870853239331968:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1784185131.702089:0:15288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185131.702119:0:15288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b155b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187334 expref: -99 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.702252:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1562 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.702270:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1562 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.702304:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1562 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185131.702319:0:15288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784185131.702568:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b155b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187334 expref: 22 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.702590:0:15288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1562 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187334 expref: 21 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.702600:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.702603:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784185131.702607:0:15288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a000, rc 0) 00000100:00100000:3.0:1784185131.702698:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+21:14450:x1870853239331968:12345-192.168.201.29@tcp:101:cat.0 Request processed in 642us (2003us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1784185131.702707:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1784185131.710587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185131.710652:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.710903:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239332096 00000100:00100000:3.0:1784185131.710917:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239332096 00000100:00100000:3.0:1784185131.711016:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1784185131.711029:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+21:2356:x1870853239332096:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185131.711052:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185131.711087:0:14114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1562 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187334 expref: 21 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.711112:0:14114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.711119:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185131.711215:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+20:2356:x1870853239332096:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 188us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185131.711224:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1784185131.711798:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239332352 00000100:00100000:2.0:1784185131.711805:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239332352 00000100:00100000:2.0:1784185131.711854:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1784185131.711863:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+20:14450:x1870853239332352:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:2.0:1784185131.712272:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+21:14450:x1870853239332352:12345-192.168.201.29@tcp:35:cat.0 Request processed in 409us (1700us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1784185131.712279:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:3.0:1784185131.788311:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784185131.795028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.795361:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239332608 00000100:00100000:3.0:1784185131.795377:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239332608 00000100:00100000:3.0:1784185131.795472:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1784185131.795484:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+21:14456:x1870853239332608:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:3.0:1784185131.795517:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185131.795545:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1570 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818733b expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.797621:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.797734:0:14129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 22 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.797744:0:14129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 22 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.797753:0:14129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.797823:0:14129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 22 pid: 15288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.797843:0:14129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 22 pid: 15288 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.797887:0:14129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265533824:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784185131.798251:0:14129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 22 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.798262:0:14129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 22 pid: 14129 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.798271:0:14129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265533952:192.168.201.29@tcp:104: 00000100:00100000:3.0:1784185131.798312:0:14129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87c9f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185131.811814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.811854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.811895:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239332736 00000100:00100000:3.0:1784185131.811906:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239332736 00010000:00010000:3.0:1784185131.811965:0:14114:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 23 pid: 15288 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.812007:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239332864 00000100:00100000:3.0:1784185131.812011:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239332864 00010000:00010000:3.0:1784185131.812023:0:14114:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 24 pid: 14129 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.812041:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1784185131.812051:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+24:2356:x1870853239332736:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185131.812070:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185131.812078:0:14114:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 24 pid: 15288 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812110:0:14114:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 24 pid: 15288 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812138:0:14114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.812144:0:14114:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812154:0:14114:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812162:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185131.812233:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+24:2356:x1870853239332736:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 182us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185131.812241:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1784185131.812297:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1784185131.812303:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+23:2356:x1870853239332864:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784185131.812311:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185131.812316:0:14114:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 23 pid: 14129 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812325:0:14114:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 23 pid: 14129 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812378:0:14114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.812382:0:14114:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812401:0:14114:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812410:0:14114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812433:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185131.812454:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+23:2356:x1870853239332864:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 150us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185131.812460:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00010000:00010000:3.0:1784185131.812524:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a200/0x63160f6fbe8b152a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de962683818731f expref: 22 pid: 15288 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.812543:0:14129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265533824:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784185131.812554:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1515 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187318 expref: 21 pid: 14129 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.812562:0:14129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5f982c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265533952:192.168.201.29@tcp:104: 00010000:00010000:3.0:1784185131.812590:0:14129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812600:0:14129:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812606:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185131.812632:0:14129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784185131.812933:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1570 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818733b expref: 22 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812951:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ae00/0x63160f6fbe8b1577 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818733b expref: 21 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.812961:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.812964:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784185131.812966:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164ae00, rc 0) 00000100:00100000:3.0:1784185131.812998:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+21:14456:x1870853239332608:12345-192.168.201.29@tcp:101:dd.0 Request processed in 17516us (20243us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1784185131.813005:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1784185131.817113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185131.817230:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239333120 00000100:00100000:2.0:1784185131.817244:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239333120 00000100:00100000:2.0:1784185131.817326:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:2.0:1784185131.817372:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+21:14456:x1870853239333120:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:2.0:1784185131.817760:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.817813:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.817826:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784185131.817883:0:15288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1784185131.817920:0:15288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da651b2d reply state 0000000004b50eb8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185131.817931:0:15288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784185131.818051:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+24:14456:x1870853239333120:12345-192.168.201.29@tcp:36:dd.0 Request processed in 680us (951us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1784185131.818060:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000020:00080000:2.0:1784185131.818066:0:15288:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784185131.828708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1784185131.828800:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.828816:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.828824:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.828831:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185131.828837:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.828846:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.828893:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.828897:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185131.828904:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.828910:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971400/0x63160f6fbe8b1585 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185131.828958:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239333248 00000100:00100000:3.0:1784185131.828970:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239333248 00000100:00100000:3.0:1784185131.829035:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1784185131.829046:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+23:14456:x1870853239333248:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:3.0:1784185131.829080:0:14128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185131.829105:0:14128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b158c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187342 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.829186:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b158c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187342 expref: 24 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.829201:0:14128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b158c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187342 expref: 24 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.829220:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.829223:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185131.829225:0:14128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b800, rc 0) 00000100:00100000:3.0:1784185131.829314:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+24:14456:x1870853239333248:12345-192.168.201.29@tcp:101:dd.0 Request processed in 269us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185131.829321:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:2.0:1784185131.860615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.860725:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239333504 00000100:00100000:3.0:1784185131.860737:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239333504 00000100:00100000:3.0:1784185131.860896:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1784185131.860907:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+24:14456:x1870853239333504:12345-192.168.201.29@tcp:103:dd.0 00010000:00010000:3.0:1784185131.860928:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784185131.860962:0:14114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b158c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187342 expref: 24 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185131.860987:0:14114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185131.860993:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784185131.861114:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+23:14456:x1870853239333504:12345-192.168.201.29@tcp:103:dd.0 Request processed in 208us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185131.861123:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1784185131.863309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185131.863405:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239333632 00000100:00100000:2.0:1784185131.863418:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239333632 00000100:00100000:2.0:1784185131.863489:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:2.0:1784185131.863502:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+23:14456:x1870853239333632:12345-192.168.201.29@tcp:58:dd.0 00000001:00080000:1.0:1784185131.863526:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:1.0:1784185131.863562:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1784185131.863584:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:1.0:1784185131.863599:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1784185131.863628:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1784185131.863677:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.863698:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185131.863713:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784185131.864677:0:15288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784185131.864890:0:15288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1784185131.864977:0:15288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1784185131.865137:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+13:14456:x1870853239333632:12345-192.168.201.29@tcp:58:dd.0 Request processed in 1632us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185131.865148:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:2.0:1784185131.868660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185131.868896:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239333760 00000100:00100000:3.0:1784185131.868910:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239333760 00000100:00100000:0.0:1784185131.870626:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1784185131.870652:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+13:14456:x1870853239333760:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:0.0:1784185131.870678:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185131.870720:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187349 expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.870871:0:14129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.870885:0:14129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187349 expref: 14 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.870910:0:14129:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.870927:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187349 expref: 14 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.870946:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:0.0:1784185131.870949:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784185131.870953:0:14129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187349 expref: 14 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185131.870963:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631da00, rc 0) 00000100:00100000:0.0:1784185131.871156:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+14:14456:x1870853239333760:12345-192.168.201.29@tcp:101:dd.0 Request processed in 515us (2507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185131.871164:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000040:00080000:2.0:1784185132.043154:0:14160:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784185132.043169:0:14160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784185132.043216:0:14160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784185132.043225:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1784185132.043447:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14160:1870853265534080:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784185132.044225:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f83a92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784185132.048630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.048884:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fbfbcd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14160:1870853265534080:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784185132.049250:0:14139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239333888 00000100:00100000:3.0:1784185132.049260:0:14139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239333888 00000100:00100000:3.0:1784185132.049323:0:14139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1784185132.049387:0:14139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239333888:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1784185132.049505:0:14139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239333888:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 172us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185132.049515:0:14139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1784185132.052273:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185132.052589:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239334016 00000100:00100000:0.0:1784185132.052603:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239334016 00000100:00100000:0.0:1784185132.052736:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1784185132.052749:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239334016:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784185132.052831:0:14130:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784185132.052997:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239334016:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 250us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185132.053006:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1784185132.056191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185132.057730:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239334144 00000100:00100000:2.0:1784185132.057748:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239334144 00000100:00100000:2.0:1784185132.057839:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1784185132.057850:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5f982c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239334144:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784185132.057956:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.057977:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.057993:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060773:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060800:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060832:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060871:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060881:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060888:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784185132.060941:0:15288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784185132.060947:0:15288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784185132.060964:0:15288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060978:0:15288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060985:0:15288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.060993:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061005:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185132.061010:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061017:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061038:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f87fe3800) 00010000:00010000:2.0:1784185132.061041:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185132.061046:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061052:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061156:0:15288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061251:0:15288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061258:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061263:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970c00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185132.061267:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061273:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061281:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b5f8545e700) 00010000:00010000:2.0:1784185132.061284:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185132.061287:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061292:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061322:0:15288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.061329:0:15288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.062639:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.062646:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185132.062650:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.062658:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.062672:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:2.0:1784185132.062675:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185132.062678:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.062684:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971000/0x63160f6fbe8b15af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185132.062805:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5f982c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239334144:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 4951us (6624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185132.062817:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1784185132.065986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185132.066302:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239334400 00000100:00100000:0.0:1784185132.066318:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239334400 00000100:00100000:0.0:1784185132.066496:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:0.0:1784185132.066508:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239334400:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784185132.066529:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185132.066553:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187350 expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.066819:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.066845:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.066857:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784185132.066875:0:14129:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784185132.067010:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067025:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067034:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067041:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185132.067047:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067077:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067090:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:1.0:1784185132.067093:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784185132.067096:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067101:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067155:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15b6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187350 expref: 16 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067164:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b5f87fe3800) 00010000:00010000:1.0:1784185132.067165:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784185132.067168:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187350 expref: 16 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.067176:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:1.0:1784185132.067256:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+15:14457:x1870853239334400:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 750us (1284us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1784185132.067447:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:3.0:1784185132.073322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.074019:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239334528 00000100:00100000:1.0:1784185132.074034:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239334528 00000100:00100000:1.0:1784185132.074231:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:1.0:1784185132.074244:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+15:14457:x1870853239334528:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784185132.074311:0:14128:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784185132.074482:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbf50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+15:14457:x1870853239334528:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 240us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.074491:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1784185132.080635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185132.081268:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239334784 00000100:00100000:0.0:1784185132.081281:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239334784 00000100:00100000:0.0:1784185132.081637:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1784185132.081651:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+15:14457:x1870853239334784:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784185132.081679:0:14130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784185132.081707:0:14130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c400/0x63160f6fbe8b15cb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187357 expref: -99 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784185132.083444:0:14130:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1784185132.083459:0:14130:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1784185132.083517:0:14130:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1784185132.084081:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.084099:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.084110:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.084188:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c400/0x63160f6fbe8b15cb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187357 expref: 18 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.084205:0:14130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187357 expref: 17 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.084212:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f87fe3f00) 00010000:00010000:0.0:1784185132.084215:0:14130:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784185132.084218:0:14130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8631c800, rc 0) 00000100:00100000:0.0:1784185132.084325:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+17:14457:x1870853239334784:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2676us (3715us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1784185132.087167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185132.087367:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239335040 00000100:00100000:2.0:1784185132.087388:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239335040 00000100:00100000:2.0:1784185132.087466:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1784185132.087495:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+18:14457:x1870853239335040:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784185132.087577:0:15288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185132.087611:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631c800/0x63160f6fbe8b15d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187357 expref: 18 pid: 14130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.087633:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f87fe3f00) 00010000:00010000:2.0:1784185132.087646:0:15288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784185132.087676:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.087694:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.087706:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185132.090939:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00010000:00010000:2.0:1784185132.091238:0:15288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091263:0:15288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091277:0:15288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091612:0:15288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091621:0:15288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091640:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091646:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970c00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185132.091651:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091659:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091673:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b5f8545e000) 00010000:00010000:2.0:1784185132.091677:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185132.091682:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091688:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93970c00/0x63160f6fbe8b15e0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091702:0:15288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091707:0:15288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091712:0:15288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091717:0:15288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971600 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185132.091720:0:15288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091737:0:15288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091745:0:15288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x48289894 (ffff9b5f8545e700) 00010000:00010000:2.0:1784185132.091747:0:15288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784185132.091751:0:15288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.091756:0:15288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971600/0x63160f6fbe8b15e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x48289894 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185132.091895:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+16:14457:x1870853239335040:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 4397us (4739us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784185132.091905:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:3.0:1784185132.096395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.096696:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239335168 00000100:00100000:1.0:1784185132.096709:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239335168 00000100:00100000:1.0:1784185132.097041:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1784185132.097052:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+16:14457:x1870853239335168:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784185132.097079:0:14129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185132.097104:0:14129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818735e expref: -99 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.097141:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b15f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.097154:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b15f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.097165:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b15f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.097301:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b15ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818735e expref: 18 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.097319:0:14129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8a00/0x63160f6fbe8b15f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818735e expref: 17 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.097325:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:1.0:1784185132.097362:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784185132.097366:0:14129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd8a00, rc 0) 00000100:00100000:1.0:1784185132.097438:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+17:14457:x1870853239335168:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 390us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.097444:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1784185132.101296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185132.101587:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239335424 00000100:00100000:0.0:1784185132.101602:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239335424 00000100:00100000:1.0:1784185132.101788:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:1.0:1784185132.101803:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+17:14457:x1870853239335424:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784185132.101918:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.101940:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.101955:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784185132.102807:0:14130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1784185132.102828:0:14130:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 530268494732ns, next at 531268490057ns, rc = 0 00000004:00010000:1.0:1784185132.102960:0:14130:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b92c622d reply state 00000000bd7df7ef transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.102974:0:14130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784185132.103575:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+19:14457:x1870853239335424:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1767us (2349us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1784185132.103587:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1784185132.110258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.111280:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239335552 00000100:00100000:3.0:1784185132.111296:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239335552 00000100:00100000:3.0:1784185132.111421:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1784185132.111436:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+19:14457:x1870853239335552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185132.111481:0:14128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185132.111513:0:14128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187365 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.111599:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 20 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.111617:0:14128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 20 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.111642:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:3.0:1784185132.111646:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185132.111650:0:14128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164b800, rc 0) 00000100:00100000:3.0:1784185132.111734:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+20:14457:x1870853239335552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 303us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185132.111742:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1784185132.118264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.118451:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239335680 00000100:00100000:1.0:1784185132.118466:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239335680 00000100:00100000:1.0:1784185132.118558:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1784185132.118570:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:111c6c5d-699b-4985-bb82-f380714e1544+5:2354:x1870853239335680:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1784185132.119323:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784185132.119629:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:111c6c5d-699b-4985-bb82-f380714e1544+6:2354:x1870853239335680:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 1055us (1374us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784185132.119641:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00010000:00010000:2.0:1784185132.119778:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.119792:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.119800:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.119807:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9200 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:2.0:1784185132.119813:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.119823:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.119863:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:2.0:1784185132.119867:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784185132.119872:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.119879:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9200/0x63160f6fbe8b15fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185132.131630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185132.131740:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239335936 00000100:00100000:2.0:1784185132.131754:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239335936 00000100:00100000:2.0:1784185132.131879:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1784185132.131892:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+19:14457:x1870853239335936:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784185132.132312:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+20:14457:x1870853239335936:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 421us (696us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784185132.132322:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1784185132.134864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.135158:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239336192 00000100:00100000:3.0:1784185132.135170:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239336192 00000100:00100000:3.0:1784185132.135246:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1784185132.135276:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+20:14457:x1870853239336192:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784185132.135608:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+20:14457:x1870853239336192:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 333us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185132.135618:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1784185132.140271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.143431:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239336320 00000100:00100000:3.0:1784185132.143452:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239336320 00000100:00100000:3.0:1784185132.143554:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1784185132.143566:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+20:14457:x1870853239336320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784185132.143595:0:14128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784185132.143626:0:14128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b160a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818736c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.143724:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1611 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.143742:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.143756:0:14128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784185132.143815:0:14128:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784185132.143848:0:14128:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1611 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.143881:0:14128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164ba00/0x63160f6fbe8b160a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818736c expref: 22 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.143903:0:14128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1611 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818736c expref: 21 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.143931:0:14128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:3.0:1784185132.143936:0:14128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784185132.143940:0:14128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f8164a000, rc 0) 00000100:00100000:3.0:1784185132.144106:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+21:14457:x1870853239336320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 541us (3849us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185132.144114:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1784185132.147924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185132.148047:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239336448 00000100:00100000:2.0:1784185132.148061:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239336448 00000100:00100000:2.0:1784185132.148133:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1784185132.148145:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:111c6c5d-699b-4985-bb82-f380714e1544+6:2355:x1870853239336448:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784185132.148170:0:14765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784185132.148196:0:14765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de9626838187373 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784185132.148230:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a58812b, blocks: 0x1 00010000:00010000:2.0:1784185132.148254:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=530s v=(0 0) 00010000:00010000:2.0:1784185132.148259:0:14765:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185132.148290:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 7 pid: 14765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.148315:0:14765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 7 pid: 14765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.148356:0:14765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5f93971600, rc 0) 00000100:00100000:2.0:1784185132.148601:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:111c6c5d-699b-4985-bb82-f380714e1544+7:2355:x1870853239336448:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 457us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185132.148609:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1784185132.152954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185132.153429:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239336704 00000100:00100000:2.0:1784185132.153442:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239336704 00000100:00100000:2.0:1784185132.153516:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1784185132.153527:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+21:14457:x1870853239336704:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784185132.153667:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+21:14457:x1870853239336704:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 141us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185132.153676:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1784185132.157731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.158114:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239336832 00000100:00100000:3.0:1784185132.158126:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239336832 00000100:00100000:3.0:1784185132.158208:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1784185132.158230:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+21:14457:x1870853239336832:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784185132.243041:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:2.0:1784185132.243067:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1784185132.243073:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1784185132.243098:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:0.0:1784185132.243973:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239336832:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 85744us (86244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185132.243990:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1784185132.245993:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784185132.246024:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265534208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784185132.246123:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185132.247698:0:16249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265534208 00000100:00100000:1.0:1784185132.247718:0:16249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265534208 00000100:00100000:1.0:1784185132.247824:0:16249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784185132.247836:0:16249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1870853265534208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1784185132.248101:0:16249:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784185132.248105:0:16249:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1784185132.248108:0:16249:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784185132.248110:0:16249:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784185131 -> 1784185131 00002000:00010000:1.0:1784185132.248113:0:16249:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1784185132.248499:0:16249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1870853265534208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 663us (2374us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1784185132.248510:0:16249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1784185132.248609:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784185132.250419:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.250808:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239336960 00000100:00100000:3.0:1784185132.250821:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239336960 00000100:00100000:3.0:1784185132.250888:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1784185132.250898:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:2354:x1870853239336960:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784185132.251049:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:2354:x1870853239336960:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 151us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784185132.251058:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000004:00080000:2.0:1784185132.252891:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b5e819d2a00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1784185132.252913:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1870853265534208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784185132.266071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.266180:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239337216 00000100:00100000:1.0:1784185132.266194:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239337216 00000100:00100000:1.0:1784185132.266278:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1784185132.266290:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239337216:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784185132.266414:0:14130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784185132.266451:0:14130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164a000/0x63160f6fbe8b1611 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818736c expref: 14 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.266499:0:14130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:1.0:1784185132.266506:0:14130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784185132.266552:0:14130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.266570:0:14130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.266583:0:14130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784185132.266871:0:14130:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e93e95f reply state 000000006dc888d5 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.266882:0:14130:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784185132.267005:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:111c6c5d-699b-4985-bb82-f380714e1544+15:14457:x1870853239337216:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 717us (947us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1784185132.267014:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00010000:00010000:3.0:1784185132.274258:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.274282:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.274290:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.274321:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185132.274327:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.274384:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.274408:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:3.0:1784185132.274411:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784185132.274418:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.274425:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b161f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14130 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185132.274908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.274994:0:16249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239337344 00000100:00100000:1.0:1784185132.275008:0:16249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239337344 00000100:00100000:1.0:1784185132.275086:0:16249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1784185132.275099:0:16249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:111c6c5d-699b-4985-bb82-f380714e1544+7:14457:x1870853239337344:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784185132.275124:0:16249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784185132.275147:0:16249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8de962683818737a expref: -99 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.275186:0:16249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 8 pid: 14765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.275210:0:16249:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185132.275215:0:16249:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185132.275371:0:16249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 8 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.275429:0:16249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 8 pid: 14765 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.275445:0:16249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 8 pid: 14765 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.275464:0:16249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16249:1870853265534336:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784185132.278990:0:16249:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784185132.280313:0:16249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16249:1870853265534336:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185132.280396:0:16249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 8 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.280426:0:16249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b5fbfbd9200, rc 0) 00000100:00100000:1.0:1784185132.280523:0:16249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:111c6c5d-699b-4985-bb82-f380714e1544+8:14457:x1870853239337344:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 5426us (5621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.280534:0:16249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1784185132.281215:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.283295:0:14113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239337472 00000100:00100000:1.0:1784185132.283315:0:14113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239337472 00010000:00010000:1.0:1784185132.283437:0:14113:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 8 pid: 14765 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.283847:0:14113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1784185132.283862:0:14113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:111c6c5d-699b-4985-bb82-f380714e1544+8:2355:x1870853239337472:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784185132.283884:0:14113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784185132.283921:0:14113:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 8 pid: 14765 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.283938:0:14113:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 8 pid: 14765 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.283969:0:14113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000283a794f/0x63160f6fbe8b1618 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187373 expref: 8 pid: 14765 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.283991:0:14113:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185132.283997:0:14113:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784185132.284007:0:14113:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 7 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.284021:0:14113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 7 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.284072:0:14113:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 7 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.284106:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14113:1870853265534464:192.168.201.29@tcp:105: 00000100:00100000:1.0:1784185132.284235:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784185132.290818:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14113:1870853265534464:192.168.201.29@tcp:105: 00010000:00010000:1.0:1784185132.290858:0:14113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784185132.290954:0:14113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:2355:x1870853239337472:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 7096us (9741us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.290970:0:14113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1784185132.297268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.297783:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239337600 00000100:00100000:3.0:1784185132.297797:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239337600 00000100:00100000:3.0:1784185132.297877:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1784185132.297889:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:2356:x1870853239337600:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784185132.298313:0:14763:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784185132.298318:0:14763:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784185131 00002000:00010000:3.0:1784185132.298320:0:14763:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784185130 00002000:00010000:3.0:1784185132.298323:0:14763:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784185131 -> 1784185131 00002000:00010000:3.0:1784185132.298325:0:14763:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784185132.298462:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+8:2356:x1870853239337600:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 574us (1209us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1784185132.298472:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1784185132.304056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185132.304261:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239337728 00000100:00100000:0.0:1784185132.304274:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239337728 00000100:00100000:0.0:1784185132.304423:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1784185132.304436:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:111c6c5d-699b-4985-bb82-f380714e1544+8:2353:x1870853239337728:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784185132.304500:0:14764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.304529:0:14764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 8 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.304540:0:14764:0:(ldlm_extent.c:371:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185132.304545:0:14764:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185132.304551:0:14764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.304864:0:14764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 8 pid: 16249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.304883:0:14764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 8 pid: 16249 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185132.304903:0:14764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc13ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14764:1870853265534592:192.168.201.29@tcp:104: 00000100:00100000:0.0:1784185132.305789:0:14764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f85e1db40 going to sleep for 11 seconds 00000100:00100000:1.0:1784185132.314202:0:14764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc13ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14764:1870853265534592:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185132.314262:0:14764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185132.317577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185132.318097:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239337856 00000100:00100000:0.0:1784185132.318113:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239337856 00010000:00010000:0.0:1784185132.318174:0:14114:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 9 pid: 16249 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185132.318431:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1784185132.318445:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+9:2356:x1870853239337856:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784185132.318473:0:14114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784185132.318505:0:14114:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 9 pid: 16249 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.318523:0:14114:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 9 pid: 16249 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.318553:0:14114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b1626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x8de962683818737a expref: 9 pid: 16249 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.318576:0:14114:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185132.318581:0:14114:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784185132.318599:0:14114:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.318612:0:14114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.318655:0:14114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784185132.318737:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:111c6c5d-699b-4985-bb82-f380714e1544+8:2356:x1870853239337856:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 295us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185132.318747:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:1.0:1784185132.319541:0:14764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319560:0:14764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319599:0:14764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319609:0:14764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319647:0:14764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319656:0:14764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185132.319661:0:14764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319671:0:14764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319687:0:14764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.319696:0:14764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b162d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.319798:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:111c6c5d-699b-4985-bb82-f380714e1544+7:2353:x1870853239337728:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 15363us (15757us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.319808:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1784185132.325096:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.325404:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239338112 00000100:00100000:1.0:1784185132.325417:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239338112 00000100:00100000:1.0:1784185132.325491:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:1.0:1784185132.325502:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+14:14457:x1870853239338112:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784185132.325629:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.325668:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.325684:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.326019:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.326032:0:14129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 15 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.326042:0:14129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.326083:0:14129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 15 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.326100:0:14129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 15 pid: 14128 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.326117:0:14129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5e819d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265534720:192.168.201.29@tcp:104: 00000100:00100000:1.0:1784185132.326218:0:14129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f902af3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784185132.331851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.332516:0:14129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5e819d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265534720:192.168.201.29@tcp:104: 00010000:00010000:1.0:1784185132.332555:0:14129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185132.334580:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239338240 00000100:00100000:2.0:1784185132.334851:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239338240 00010000:00010000:2.0:1784185132.334927:0:14115:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 16 pid: 14128 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185132.334967:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1784185132.334978:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:111c6c5d-699b-4985-bb82-f380714e1544+16:2356:x1870853239338240:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784185132.334999:0:14115:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784185132.335008:0:14115:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 16 pid: 14128 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.335034:0:14115:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 16 pid: 14128 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.335061:0:14115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b800/0x63160f6fbe8b1603 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x8de9626838187365 expref: 16 pid: 14128 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.335083:0:14115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:2.0:1784185132.335090:0:14115:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.335101:0:14115:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.335110:0:14115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.335157:0:14115:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784185132.335247:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:111c6c5d-699b-4985-bb82-f380714e1544+15:2356:x1870853239338240:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 270us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185132.335269:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:3.0:1784185132.337630:0:14129:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.337653:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784185132.337926:0:14129:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1784185132.338116:0:14129:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1784185132.338159:0:14129:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1784185132.338272:0:14129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9152300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14129:1870853265534848:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784185132.345106:0:14129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185132.345457:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265534848 00000100:00100000:2.0:1784185132.345604:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265534848 00000100:00100000:3.0:1784185132.345606:0:14129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f84aaecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784185132.345710:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784185132.345726:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14129:x1870853265534848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784185132.345917:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14129:x1870853265534848:12345-0@lo:1000:mdt00_001.0 Request processed in 194us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185132.345926:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784185132.346525:0:14129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9152300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14129:1870853265534848:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1784185132.353086:0:14129:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1784185132.353213:0:14129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9152300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14129:1870853265534976:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784185132.353302:0:14129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185132.353386:0:14129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87c9f540 going to sleep for 11 seconds 00000100:00100000:2.0:1784185132.355941:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265534976 00000100:00100000:2.0:1784185132.355962:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265534976 00000100:00100000:2.0:1784185132.356054:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784185132.356067:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14129:x1870853265534976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784185132.356531:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14129:x1870853265534976:12345-0@lo:1000:mdt00_001.0 Request processed in 465us (3227us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784185132.356540:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784185132.356911:0:14129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9152300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14129:1870853265534976:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1784185132.356969:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.356981:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.356990:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357017:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185132.357022:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357031:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357053:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:3.0:1784185132.357056:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185132.357061:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357067:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd8400/0x63160f6fbe8b163b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357109:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357116:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357122:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357127:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93971c00 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:3.0:1784185132.357130:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357136:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357154:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:3.0:1784185132.357157:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784185132.357179:0:14129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187349 expref: 18 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357191:0:14129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187349 expref: 18 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357200:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187349 expref: 18 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.357285:0:14129:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8631da00/0x63160f6fbe8b159a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x8de9626838187349 expref: 18 pid: 14129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784185132.357302:0:14129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9153b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265535104:192.168.201.29@tcp:105: 00000100:00100000:3.0:1784185132.357443:0:14129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b5f87c9fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784185132.360696:0:14129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9153b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14129:1870853265535104:192.168.201.29@tcp:105: 00010000:00010000:1.0:1784185132.360746:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360755:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f93971c00/0x63160f6fbe8b1593 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360803:0:14129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360818:0:14129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360830:0:14129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360839:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360846:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360851:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360857:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fc2169000 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185132.360861:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360868:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360895:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:1.0:1784185132.360906:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784185132.360910:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360916:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fc2169000/0x63160f6fbe8b1642 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360927:0:14129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360934:0:14129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360939:0:14129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360945:0:14129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc217e4f0) 00010000:00010000:1.0:1784185132.360948:0:14129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360955:0:14129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360963:0:14129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b5fa00c7400) 00010000:00010000:1.0:1784185132.360966:0:14129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784185132.360968:0:14129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185132.360973:0:14129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5fbfbd9400/0x63160f6fbe8b1634 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14129 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.361260:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:111c6c5d-699b-4985-bb82-f380714e1544+18:14457:x1870853239338112:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 35758us (36178us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1784185132.361281:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000020:00080000:1.0:1784185132.361288:0:14129:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784185132.362367:0:14160:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784185132.362375:0:14160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784185132.362409:0:14160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784185132.362415:0:14160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784185132.364123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.367636:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239338368 00000100:00100000:3.0:1784185132.367650:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239338368 00000100:00100000:2.0:1784185132.367901:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1784185132.367917:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5faf8ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+18:14456:x1870853239338368:12345-192.168.201.29@tcp:49:dd.0 00000100:00100000:2.0:1784185132.368636:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5faf8ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:111c6c5d-699b-4985-bb82-f380714e1544+18:14456:x1870853239338368:12345-192.168.201.29@tcp:49:dd.0 Request processed in 709us (4510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185132.368652:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1784185132.368930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.368991:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239338624 00000100:00100000:3.0:1784185132.369005:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239338624 00000100:00100000:3.0:1784185132.369076:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1784185132.369086:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+18:14457:x1870853239338624:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784185132.371400:0:14132:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784185132.371545:0:14132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1784185132.371608:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.371627:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.371639:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.371647:0:14132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.371654:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.371660:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.371679:0:14132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784185132.372111:0:14117:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784185132.372128:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.372141:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164b600 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185132.372146:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.372174:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.372196:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b5f8c4f5b00) 00010000:00010000:2.0:1784185132.372199:0:14117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784185132.372205:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.372213:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b5f8164b600/0x63160f6fbe8b1649 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.372607:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185132.372609:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784185132.372611:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784185132.377850:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:111c6c5d-699b-4985-bb82-f380714e1544+20:14457:x1870853239338624:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 8752us (8908us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1784185132.377866:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000020:00080000:3.0:1784185132.377883:0:14132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784185132.658804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.658943:0:14768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239338752 00000100:00100000:3.0:1784185132.658954:0:14768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239338752 00000100:00100000:3.0:1784185132.659022:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1784185132.659032:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc13a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:111c6c5d-699b-4985-bb82-f380714e1544+7:2355:x1870853239338752:12345-192.168.201.29@tcp:4:dd.0 00002000:00010000:3.0:1784185132.659084:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a58812b, atime: 0x6a58812a, ctime: 0x6a58812b, blocks: 0x1 00010000:00010000:3.0:1784185132.659093:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.659123:0:14768:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1784185132.659127:0:14768:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185132.659135:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.659152:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.668864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.669406:0:14770:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784185132.669419:0:14770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1784185132.671390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.671450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.671463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.671473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1784185132.671502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1784185132.671584:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784185132.671615:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239338880 00000100:00100000:1.0:1784185132.671623:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239338880 00000100:00100000:1.0:1784185132.671687:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784185132.671702:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339136 00000100:00100000:1.0:1784185132.671704:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339136 00000100:00100000:1.0:1784185132.671718:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784185132.671723:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339392 00000100:00100000:1.0:1784185132.671725:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339392 00000100:00100000:1.0:1784185132.671736:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784185132.671740:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339008 00000100:00100000:1.0:1784185132.671742:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339008 00000100:00100000:1.0:1784185132.671763:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784185132.671768:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339264 00000100:00100000:1.0:1784185132.671771:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339264 00000100:00100000:1.0:1784185132.671782:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784185132.671786:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339520 00000100:00100000:1.0:1784185132.671788:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339520 00000100:00100000:3.0:1784185132.672718:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1784185132.672733:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:111c6c5d-699b-4985-bb82-f380714e1544+14:2356:x1870853239338880:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:3.0:1784185132.672781:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.672799:0:16251:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185132.672803:0:16251:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784185132.672810:0:16251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784185132.672824:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.684425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1784185132.684529:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1784185132.684540:0:14769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1784185132.685159:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339648 00000100:00100000:0.0:1784185132.685170:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339648 00000100:00100000:0.0:1784185132.685699:0:16252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1784185132.685710:0:16252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:111c6c5d-699b-4985-bb82-f380714e1544+16:2356:x1870853239339136:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:0.0:1784185132.685749:0:16252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.685808:0:16252:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185132.685813:0:16252:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185132.685819:0:16252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.685833:0:16252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185132.746716:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265535232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784185132.746811:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185132.746920:0:14767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265535232 00000100:00100000:1.0:1784185132.746929:0:14767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265535232 00000100:00100000:1.0:1784185132.747003:0:14767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784185132.747013:0:14767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265535232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784185132.747050:0:14767:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784185132.747119:0:14767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1870853265535232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.747127:0:14767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784185132.747177:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1870853265535232:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784185132.747258:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784185132.762432:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265535488:0@lo:400:kworker.0 00000100:00100000:2.0:1784185132.762523:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185132.762566:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb9153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265535360:0@lo:400:kworker.0 00000100:00100000:2.0:1784185132.762602:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784185132.762614:0:3315:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265535616:0@lo:400:kworker.0 00000100:00100000:3.0:1784185132.762643:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784185132.762659:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185132.762706:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784185132.762719:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fc1645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265535744:0@lo:400:kworker.0 00000100:00100000:1.0:1784185132.764875:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265535488 00000100:00100000:1.0:1784185132.764890:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265535488 00000100:00100000:1.0:1784185132.764954:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265535616 00000100:00100000:1.0:1784185132.764958:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265535616 00000100:00100000:1.0:1784185132.764995:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784185132.765004:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fbfbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265535488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185132.765092:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fbfbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1870853265535488:12345-0@lo:400:kworker.0 Request processed in 88us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.765099:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784185132.765115:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784185132.765121:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265535616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185132.765147:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1870853265535616:12345-0@lo:400:kworker.0 Request processed in 26us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.765152:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784185132.765170:0:14122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265535360 00000100:00100000:1.0:1784185132.765173:0:14122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265535360 00000100:00100000:1.0:1784185132.765196:0:14122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784185132.765203:0:14122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265535360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784185132.765235:0:14122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2cf958e-f219-4c8a-8fdf-735d6ed095ff+19:3314:x1870853265535360:12345-0@lo:400:kworker.0 Request processed in 32us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185132.765241:0:14122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784185132.767284:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784185132.767412:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d2cf958e-f219-4c8a-8fdf-735d6ed095ff:3314:1870853265535360:0@lo:400:kworker.0 00000100:00080000:3.0:1784185132.767519:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784185132.767862:0:14130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265535744 00000100:00100000:0.0:1784185132.767873:0:14130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265535744 00000100:00100000:0.0:1784185132.767953:0:14130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784185132.767964:0:14130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265535744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784185132.768084:0:14130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1870853265535744:12345-0@lo:400:kworker.0 Request processed in 121us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185132.768093:0:14130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1784185132.768359:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784185132.768408:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1870853265535744:0@lo:400:kworker.0 00000100:00100000:2.0:1784185132.775600:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fc1644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1870853265535616:0@lo:400:kworker.0 00000100:00100000:2.0:1784185132.775636:0:3315:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb9152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1870853265535488:0@lo:400:kworker.0 00010000:00010000:2.0:1784185132.810640:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784185132.861492:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1784185132.861594:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1784185132.861611:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:0.0:1784185132.861641:0:14768:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1784185132.861654:0:14768:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1784185131 -> 1784185132 00002000:00010000:0.0:1784185132.861657:0:14768:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784185131 -> 1784185132 00002000:00010000:0.0:1784185132.861660:0:14768:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1784185132.861680:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.861696:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.861706:0:14768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.861715:0:14768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164ba00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185132.861721:0:14768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.861731:0:14768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.861775:0:14768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.861784:0:14768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046bdcdcf/0x63160f6fbe8b1650 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185132.863469:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc13a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:111c6c5d-699b-4985-bb82-f380714e1544+18:2355:x1870853239338752:12345-192.168.201.29@tcp:4:dd.0 Request processed in 204421us (204660us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1784185132.863487:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1784185132.863562:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1784185132.863580:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:111c6c5d-699b-4985-bb82-f380714e1544+17:2356:x1870853239339392:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:0.0:1784185132.863632:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.863653:0:14768:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784185132.863658:0:14768:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185132.863667:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.863683:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784185132.973210:0:16251:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1784185132.973220:0:16251:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1784185132.973235:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.973249:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.973258:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.973266:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8164a200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185132.973271:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.973302:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.973324:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.973360:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040876b5e/0x63160f6fbe8b1657 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185132.973616:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:111c6c5d-699b-4985-bb82-f380714e1544+19:2356:x1870853239338880:12345-192.168.201.29@tcp:4:dd.0 Request processed in 300882us (304757us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784185132.973629:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1784185132.973781:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1784185132.973794:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:111c6c5d-699b-4985-bb82-f380714e1544+18:2356:x1870853239339008:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:0.0:1784185132.973978:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.973992:0:16251:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185132.973997:0:16251:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185132.974003:0:16251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185132.974015:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784185132.974267:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1784185132.979211:0:16252:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1784185132.979233:0:16252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979244:0:16252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979269:0:16252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979277:0:16252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631c800 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185132.979282:0:16252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979293:0:16252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979312:0:16252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979320:0:16252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc4fa80/0x63160f6fbe8b165e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784185132.979445:0:16252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:111c6c5d-699b-4985-bb82-f380714e1544+14:2356:x1870853239339136:12345-192.168.201.29@tcp:4:dd.0 Request processed in 293732us (308058us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784185132.979470:0:16252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1784185132.979503:0:16252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1784185132.979515:0:16252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:111c6c5d-699b-4985-bb82-f380714e1544+13:2356:x1870853239339264:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1784185132.979547:0:16252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979559:0:16252:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185132.979569:0:16252:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784185132.979575:0:16252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185132.979587:0:16252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784185133.075269:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00010000:00010000:0.0:1784185133.075925:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.075943:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.075953:0:14768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.075961:0:14768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f8631ce00 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185133.075965:0:14768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.075974:0:14768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.075996:0:14768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.076004:0:14768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000686fcde4/0x63160f6fbe8b1665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185133.076108:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:111c6c5d-699b-4985-bb82-f380714e1544+15:2356:x1870853239339392:12345-192.168.201.29@tcp:4:dd.0 Request processed in 212531us (404651us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1784185133.076120:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1784185133.076164:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1784185133.076178:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb9151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:111c6c5d-699b-4985-bb82-f380714e1544+14:2356:x1870853239339520:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:0.0:1784185133.076213:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.076224:0:14768:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185133.076229:0:14768:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185133.076235:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.076246:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784185133.147640:0:16251:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1784185133.147655:0:16251:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1784185133.147677:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.147695:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.147706:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.147715:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185133.147721:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.147774:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.147805:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.147814:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ebb69e/0x63160f6fbe8b166c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185133.147958:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:111c6c5d-699b-4985-bb82-f380714e1544+16:2356:x1870853239339008:12345-192.168.201.29@tcp:4:dd.0 Request processed in 174160us (476484us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1784185133.147972:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1784185133.148015:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1784185133.148030:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5e819d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:111c6c5d-699b-4985-bb82-f380714e1544+15:2355:x1870853239339648:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:0.0:1784185133.148075:0:16251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.148090:0:16251:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185133.148096:0:16251:0:(ldlm_extent.c:371:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784185133.148104:0:16251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.148119:0:16251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185133.148642:0:16252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185133.148661:0:16252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185133.148671:0:16252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185133.148679:0:16252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5f93970200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:2.0:1784185133.148684:0:16252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185133.148692:0:16252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185133.148724:0:16252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784185133.148733:0:16252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69b3131/0x63160f6fbe8b1673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784185133.148940:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:1.0:1784185133.148967:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000100:00100000:2.0:1784185133.149044:0:16252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:111c6c5d-699b-4985-bb82-f380714e1544+11:2356:x1870853239339264:12345-192.168.201.29@tcp:4:dd.0 Request processed in 169526us (477561us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784185133.149057:0:16252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000001:00080000:1.0:1784185133.218236:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1784185133.218432:0:14768:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1784185133.218438:0:14768:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1784185133.218458:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185133.218475:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185133.218485:0:14768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185133.218494:0:14768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd9200 already unused, calling callback (ffffffffc1775230) 00010000:00010000:1.0:1784185133.218500:0:14768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185133.218510:0:14768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185133.218536:0:14768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784185133.218544:0:14768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea933184/0x63160f6fbe8b167a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784185133.218695:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb9151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:111c6c5d-699b-4985-bb82-f380714e1544+9:2356:x1870853239339520:12345-192.168.201.29@tcp:4:dd.0 Request processed in 142515us (547184us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1784185133.218723:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000001:00080000:1.0:1784185133.319192:0:6613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1784185133.319590:0:16251:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1784185133.319611:0:16251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.319627:0:16251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.319637:0:16251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.319644:0:16251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b5fbfbd8400 already unused, calling callback (ffffffffc1775230) 00010000:00010000:0.0:1784185133.319650:0:16251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.319661:0:16251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.319684:0:16251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784185133.319692:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fec16ed/0x63160f6fbe8b1681 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784185133.320035:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5e819d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:111c6c5d-699b-4985-bb82-f380714e1544+5:2355:x1870853239339648:12345-192.168.201.29@tcp:4:dd.0 Request processed in 172001us (635610us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1784185133.320065:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00010000:00010000:2.0:1784185133.834550:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784185134.676514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185134.676562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185134.676597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185134.676619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185134.676639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185134.676658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185134.676681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1784185134.676800:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239340032 00000100:00100000:2.0:1784185134.676812:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239340032 00000100:00100000:2.0:1784185134.676881:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239340544 00000100:00100000:2.0:1784185134.676884:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239340544 00000100:00100000:2.0:1784185134.676899:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239340160 00000100:00100000:2.0:1784185134.676901:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239340160 00000100:00100000:2.0:1784185134.676913:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239340416 00000100:00100000:2.0:1784185134.676915:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239340416 00000100:00100000:2.0:1784185134.676933:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1784185134.676944:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239340032:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185134.677179:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239340032:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 235us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185134.677188:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1784185134.677212:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1784185134.677218:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239340544:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185134.677266:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239340544:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185134.677274:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1784185134.677287:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1784185134.677293:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239340160:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185134.677315:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:111c6c5d-699b-4985-bb82-f380714e1544+5:2353:x1870853239340160:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185134.677321:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1784185134.677357:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1784185134.677364:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239340416:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185134.677388:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e95cba2-b62d-4560-961a-ec21662cdd89+5:2353:x1870853239340416:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185134.677394:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1784185134.677416:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239340288 00000100:00100000:2.0:1784185134.677420:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239340288 00000100:00100000:2.0:1784185134.677451:0:15288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339904 00000100:00100000:2.0:1784185134.677454:0:15288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339904 00000100:00100000:2.0:1784185134.677476:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1784185134.677483:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2353:x1870853239340288:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185134.677517:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e95cba2-b62d-4560-961a-ec21662cdd89+6:2353:x1870853239340288:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185134.677524:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1784185134.677535:0:15288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1784185134.677540:0:15288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+20:2353:x1870853239339904:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1784185134.677572:0:15288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb7121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:111c6c5d-699b-4985-bb82-f380714e1544+20:2353:x1870853239339904:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784185134.677578:0:15288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00080000:2.0:1784185134.677593:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784185134.677598:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784185134.677600:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784185134.678317:0:14121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853239339776 00000100:00100000:0.0:1784185134.678326:0:14121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853239339776 00000100:00100000:0.0:1784185134.678395:0:14121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:0.0:1784185134.678403:0:14121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fb8cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2353:x1870853239339776:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1784185134.678441:0:14121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fb8cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b17f98c2-fa7f-4904-ad4f-e776c7eb9c73+13:2353:x1870853239339776:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 40us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1784185134.678447:0:14121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00010000:00010000:2.0:1784185134.860541:0:14116:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784185135.154626:0:16289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1784185135.821120:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b5fb7120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265535872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784185135.821204:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784185135.821415:0:14767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870853265535872 00000100:00100000:1.0:1784185135.821425:0:14767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870853265535872 00000100:00100000:1.0:1784185135.821491:0:14767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784185135.821500:0:14767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b5fc1645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265535872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784185135.821534:0:14767:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1784185135.821585:0:14767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b5fc1645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1870853265535872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784185135.821592:0:14767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784185135.821682:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1784185135.821689:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b5e819d2a00, transno 8589934595 00000004:00080000:0.0:1784185135.821729:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1784185135.821758:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b5fb7120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1870853265535872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784185135.822245:0:14124:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784185135.882967:0:14117:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29758 lines, 29758 kept, 0 dropped, 0 bad.